{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":644133741,"defaultBranch":"main","name":"delta-kernel-rs","ownerLogin":"delta-incubator","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-05-22T22:25:23.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/83792485?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726005990.0","currentOid":""},"activityList":{"items":[{"before":"4c9a6ac4703310f317ed20b6c41c571e5fd0768b","after":"b4e540380575e72b93d5171338c684246abec172","ref":"refs/heads/main","pushedAt":"2024-09-24T01:12:11.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"Support annotation for nullable values in a container (#342)\n\nWhen arrow fixes https://github.com/apache/arrow-rs/issues/6391, our\ncode will start to fail since we don't allow for nulls in partition\nvalues, but they can be null.\n\nThis adds an annotation that will cause the generated schema to allow\nnull values. We already have the semantics that if value is null on the\narrow side, then `materialize` will simply not include it in the final\nmap, so nothing else needs to change.\n\nTested by:\n1. All tests still pass\n2. Added a new test for the `add` schema that ensures it sets the\n`value_contains_null` field to true on the `partitionValues` map.\n3. Looking at generated code and noting we get\n```rust\nHashMap::<\n String,\n String,\n>::get_nullable_container_struct_field(\"partitionValues\"),\n```\n\n---------\n\nCo-authored-by: Nick Lanham ","shortMessageHtmlLink":"Support annotation for nullable values in a container (#342)"}},{"before":"896accc2f991b8ee7fff80a09f1e547b9fb086c8","after":"4c9a6ac4703310f317ed20b6c41c571e5fd0768b","ref":"refs/heads/main","pushedAt":"2024-09-21T15:54:02.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"add contributing file (#329)\n\nFixes #321\n\nThe CONTRIBUTING.md file is conventional in OSS repos. This one draws\ninspiration from the [Rails CONTRIBUTING.md\nfile](https://github.com/rails/rails/blob/main/CONTRIBUTING.md).","shortMessageHtmlLink":"add contributing file (#329)"}},{"before":"b3a3b7d770114f067006262ae0763da6429532ad","after":"896accc2f991b8ee7fff80a09f1e547b9fb086c8","ref":"refs/heads/main","pushedAt":"2024-09-20T20:53:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"feat: add github action to self-assign the issue (#337)\n\nCloses #324.\r\n\r\n---------\r\n\r\nSigned-off-by: tailm \r\nSigned-off-by: Tai Le Manh \r\nCo-authored-by: tailm ","shortMessageHtmlLink":"feat: add github action to self-assign the issue (#337)"}},{"before":"1a66fb9324703bedecc516040c5a6f2fa8271410","after":"b3a3b7d770114f067006262ae0763da6429532ad","ref":"refs/heads/main","pushedAt":"2024-09-19T20:45:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"OussamaSaoudi-db","name":"Oussama Saoudi","path":"/OussamaSaoudi-db","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/181137836?s=80&v=4"},"commit":{"message":"Fix column name for protocol in P&M query (#343)\n\nThis is a followup to [this\r\nPR](https://github.com/delta-incubator/delta-kernel-rs/pull/336) which\r\npatches a mistake in the filter. Protocol has a\r\n`protocol.minReaderVersion`, and no `protocol.min_reader_version` field.\r\n\r\nThis PR also fixes an intermittent test failure caused by repeat\r\ninitialization of tracing. This PR changes the `test_scan_data` test to\r\ninstead use the test_log crate for initializing logs.","shortMessageHtmlLink":"Fix column name for protocol in P&M query (#343)"}},{"before":"f6b89425c7bf2e314e9398118e18e890f7dfde7b","after":"1a66fb9324703bedecc516040c5a6f2fa8271410","ref":"refs/heads/main","pushedAt":"2024-09-19T15:04:06.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"Support reading tables with type widening in default engine (#335)\n\nType widening allows changing the type of an existing column in a Delta\r\ntable to a wider type.\r\nSee\r\nhttps://github.com/delta-io/delta/blob/master/protocol_rfcs/type-widening.md\r\n\r\nThis change improves the default engine to enable upcasting conversions\r\non read that are required to read tables that have a type change\r\napplied: data files written before the widening type change will contain\r\ndata stored using a narrower type that must be upcast to the wider type\r\nin the current table schema.\r\n\r\nChanges:\r\n - Allow conversions:\r\n - int8 -> int16 -> int32 -> int64\r\n - float32 -> float64\r\n - date -> timestamp without timezone\r\n - integers -> float64\r\n- integers and decimals -> decimals, as long as the target precision and\r\nscale are sufficient to store all values without losing precision\r\n\r\nThis doesn't cover casting inside nested struct/array/map, which doesn't\r\nseem to be properly supported yet.\r\n\r\nTesting:\r\n- Added tests reading a table with various type changes applied,\r\ngenerated using delta spark 4.0 preview.\r\n- Added unit tests for `can_upcast_to_decimal`, returning whether a\r\ngiven type can be upcast to a decimal.","shortMessageHtmlLink":"Support reading tables with type widening in default engine (#335)"}},{"before":"ed1919a719cc4e6886c358fed32ee1839bc0eeb6","after":"f6b89425c7bf2e314e9398118e18e890f7dfde7b","ref":"refs/heads/main","pushedAt":"2024-09-18T19:03:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"OussamaSaoudi-db","name":"Oussama Saoudi","path":"/OussamaSaoudi-db","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/181137836?s=80&v=4"},"commit":{"message":"Adding predicate to protocol and metadata log replay query (#336)\n\nPass a predicate hint to `Engine` in `read_metadata` so that log files\r\nare filtered to contain either metadata or protocol columns. The motivation of this change is to filter log data at the engine level instead of needlessly passing EngineData back to the kernel","shortMessageHtmlLink":"Adding predicate to protocol and metadata log replay query (#336)"}},{"before":"254732249f89c888b79b2a312b272e78f8dcd35a","after":"ed1919a719cc4e6886c358fed32ee1839bc0eeb6","ref":"refs/heads/main","pushedAt":"2024-09-11T23:18:04.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"OussamaSaoudi-db","name":"Oussama Saoudi","path":"/OussamaSaoudi-db","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/181137836?s=80&v=4"},"commit":{"message":"Remove feature flag requirement for GetData on () (#334)\n\nCurrently, the GetData trait implementation for unit type `()` is in\r\narrow_get_data.rs. This makes the trait impl blocked behind either the\r\n`default-engine` or `sync-engine` flags. This PR moves the GetData trait\r\nimplementation to engine_data.rs to make it available without the flags\r\nso that it can be used by other engines.\r\n\r\nCloses: #315","shortMessageHtmlLink":"Remove feature flag requirement for GetData on () (#334)"}},{"before":"04e6a1849fbb950e212ec2cb98bc98f692bb679b","after":"254732249f89c888b79b2a312b272e78f8dcd35a","ref":"refs/heads/main","pushedAt":"2024-09-10T22:01:58.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"fix: add arrow-buffer to arrow-expression feature (#332)\n\nWhen running cargo-publish the delta_kernel crate failed to compile;\r\nneeded to add `arrow-buffer` to `arrow-expression` feature.\r\n```\r\nerror[E0432]: unresolved import `arrow_buffer`\r\n --> src/engine/arrow_expression.rs:13:5\r\n |\r\n13 | use arrow_buffer::OffsetBuffer;\r\n | ^^^^^^^^^^^^ use of undeclared crate or module `arrow_buffer`\r\n\r\nFor more information about this error, try `rustc --explain E0432`.\r\nerror: could not compile `delta_kernel` (lib) due to 1 previous error\r\n```","shortMessageHtmlLink":"fix: add arrow-buffer to arrow-expression feature (#332)"}},{"before":"2291a874fd00bbae02cb7238b2a2599a17032c17","after":"04e6a1849fbb950e212ec2cb98bc98f692bb679b","ref":"refs/heads/main","pushedAt":"2024-09-10T20:56:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"prepare 0.3.1 (#330)\n\nrelease 0.3.1 ๐Ÿš€","shortMessageHtmlLink":"prepare 0.3.1 (#330)"}},{"before":"c3346d6a6c8eda4b4cb7ae0c95c4f1cc1e394485","after":"2291a874fd00bbae02cb7238b2a2599a17032c17","ref":"refs/heads/main","pushedAt":"2024-09-09T23:51:49.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"Merge pull request #325 from zachschuermann/update-deps\n\n[chore] update deps, stop using caret","shortMessageHtmlLink":"Merge pull request #325 from zachschuermann/update-deps"}},{"before":"0791631aa753fb8ead66bea0531472a9b3d56e73","after":"c3346d6a6c8eda4b4cb7ae0c95c4f1cc1e394485","ref":"refs/heads/main","pushedAt":"2024-09-09T20:34:36.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"We were passing the wrong offset value when computing list offsets (#327)\n\nFix it, and add a test\r\n\r\n---------\r\n\r\nCo-authored-by: Nick Lanham ","shortMessageHtmlLink":"We were passing the wrong offset value when computing list offsets (#327"}},{"before":"1459b306db5e11e37366dee39c780fcf8e3ff580","after":"0791631aa753fb8ead66bea0531472a9b3d56e73","ref":"refs/heads/main","pushedAt":"2024-09-09T20:20:15.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"hntd187","name":"Stephen Carman","path":"/hntd187","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6778339?s=80&v=4"},"commit":{"message":"Merge pull request #328 from ion-elgreco/fix/schema_metadata\n\nfix: metadata string conversion","shortMessageHtmlLink":"Merge pull request #328 from ion-elgreco/fix/schema_metadata"}},{"before":null,"after":"a47c48ac00a1afea347f2435221c7550d5d4ff9f","ref":"refs/heads/variant","pushedAt":"2024-08-22T14:28:25.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"hntd187","name":"Stephen Carman","path":"/hntd187","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6778339?s=80&v=4"},"commit":{"message":"nightly variant impl POC","shortMessageHtmlLink":"nightly variant impl POC"}},{"before":"e4c07dd1cb382897a9cb16ef734fd02843b60da5","after":"1459b306db5e11e37366dee39c780fcf8e3ff580","ref":"refs/heads/main","pushedAt":"2024-08-19T00:28:07.000Z","pushType":"pr_merge","commitsCount":30,"pusher":{"login":"hntd187","name":"Stephen Carman","path":"/hntd187","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6778339?s=80&v=4"},"commit":{"message":"Merge pull request #270 from hntd187/in-not-in\n\nFirst pass on IN/Not In","shortMessageHtmlLink":"Merge pull request #270 from hntd187/in-not-in"}},{"before":"b2bb39a01549e45ddd714fa7313ca8baed63261f","after":"e4c07dd1cb382897a9cb16ef734fd02843b60da5","ref":"refs/heads/main","pushedAt":"2024-08-14T17:23:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"fix: list log files with checkpoint when version is None (#312)\n\nPreviously, if read_last_checkpoint returned a valid _last_checkpoint\r\nhint but the version requested was None (i.e. requesting the lastest\r\nversion) we would still list_log_files without listing from the\r\ncheckpoint hint. This change will detect when we have a valid\r\n_last_checkpoint and request the latest version and instead\r\nlist_log_files_with_checkpoint\r\n\r\n---------\r\n\r\nCo-authored-by: Mervyn Zhang \r\nCo-authored-by: Zach Schuermann ","shortMessageHtmlLink":"fix: list log files with checkpoint when version is None (#312)"}},{"before":"314326460156867f5bb8cf70a5318030925ec9d2","after":"b2bb39a01549e45ddd714fa7313ca8baed63261f","ref":"refs/heads/main","pushedAt":"2024-08-13T18:08:02.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"fix: allow kernel to read tables with invalid _last_checkpoint (#311)\n\nPreviously, `read_last_checkpoint` would return `Err()` if\r\njson parsing of the `_last_checkpoint` file failed. This caused the\r\nupstream call to fail due to propagation of the error. Instead we now\r\nreturn `None` from `read_last_checkpoint` in this case - similar to what\r\nis returned if the `_last_checkpoint` is not found. This allows log\r\nreplay to continue without the hint and read the table.\r\n\r\nAdditionally, this unblocks the `corrupted-last-checkpoint-kernel`\r\ngolden table test.","shortMessageHtmlLink":"fix: allow kernel to read tables with invalid _last_checkpoint (#311)"}},{"before":"886ac9cffd9ec551b51aae85bf07e236ed829f63","after":"314326460156867f5bb8cf70a5318030925ec9d2","ref":"refs/heads/main","pushedAt":"2024-08-08T18:08:23.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"Enable some more golden tests (#301)\n\nChanges made:\r\n- Use `element` as list root name, enable a bunch of tests. This matches\r\nthe [parquet\r\nspec](https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#lists)\r\n- Allow sorting by lists if they contain primitives. arrow supports this\r\nand then we can test on tables that are all list cols\r\n- make the call to `assert_columns_match` pass things in the expected\r\norder.","shortMessageHtmlLink":"Enable some more golden tests (#301)"}},{"before":"f8b048589570bb84cf9ed720b8c8da506bbf4a8f","after":"886ac9cffd9ec551b51aae85bf07e236ed829f63","ref":"refs/heads/main","pushedAt":"2024-08-07T19:29:38.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"exclude golden tests+data when publishing package (#307)\n\nWe exceeded 10MB limit on crates.io for package size. Exclude golden\r\ntests and golden data from publishing to stay under the limit.\r\n\r\nnew package size:\r\n```\r\n Finished `dev` profile [unoptimized + debuginfo] target(s) in 19.96s\r\n Packaged 112 files, 557.5KiB (120.8KiB compressed)\r\n```\r\n\r\nold package size (and error):\r\n```\r\n Finished `dev` profile [unoptimized + debuginfo] target(s) in 22.06s\r\n Packaged 203 files, 13.9MiB (13.0MiB compressed)\r\n Uploading delta_kernel v0.3.0 (/Users/zach.schuermann/dev/delta-kernel-rs/kernel)\r\nerror: failed to publish to registry at https://crates.io\r\n\r\nCaused by:\r\n the remote server responded with an error (status 413 Payload Too Large): max upload size is: 10485760\r\n```","shortMessageHtmlLink":"exclude golden tests+data when publishing package (#307)"}},{"before":"969bd23be6286d0fe23f471ed85e1c334edd086c","after":"f8b048589570bb84cf9ed720b8c8da506bbf4a8f","ref":"refs/heads/main","pushedAt":"2024-08-07T17:46:03.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"Merge pull request #306 from zachschuermann/readme-0.3\n\nfix version in readme","shortMessageHtmlLink":"Merge pull request #306 from zachschuermann/readme-0.3"}},{"before":"e0a2e5e7a455f6bdf816afff1783bb61a2f4cb8c","after":"969bd23be6286d0fe23f471ed85e1c334edd086c","ref":"refs/heads/main","pushedAt":"2024-08-07T16:45:05.000Z","pushType":"pr_merge","commitsCount":5,"pusher":{"login":"rtyler","name":"R. Tyler Croy","path":"/rtyler","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26594?s=80&v=4"},"commit":{"message":"Merge pull request #305 from zachschuermann/cut-0.2.1\n\nprepare 0.3.0","shortMessageHtmlLink":"Merge pull request #305 from zachschuermann/cut-0.2.1"}},{"before":"0a3834b945bd0dc020c876947f9a6c4acd3bbdd4","after":"e0a2e5e7a455f6bdf816afff1783bb61a2f4cb8c","ref":"refs/heads/main","pushedAt":"2024-08-06T21:12:21.000Z","pushType":"pr_merge","commitsCount":12,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"Merge pull request #287 from zachschuermann/coverage\n\nAdd code coverage to CI","shortMessageHtmlLink":"Merge pull request #287 from zachschuermann/coverage"}},{"before":"9a81b342f1ad62c47ad63d929fdf217949076434","after":"0a3834b945bd0dc020c876947f9a6c4acd3bbdd4","ref":"refs/heads/main","pushedAt":"2024-08-06T19:49:35.000Z","pushType":"pr_merge","commitsCount":24,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"Merge pull request #295 from zachschuermann/golden-table-tests-3\n\nAdd golden table tests from delta spark/java kernel","shortMessageHtmlLink":"Merge pull request #295 from zachschuermann/golden-table-tests-3"}},{"before":"7fe738708ce3315e97b3e8077783054ee566f9b8","after":"9a81b342f1ad62c47ad63d929fdf217949076434","ref":"refs/heads/main","pushedAt":"2024-08-05T18:58:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"roeap","name":"Robert Pack","path":"/roeap","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/42610831?s=80&v=4"},"commit":{"message":"fix: make Map arrow type consistent with Map parquet type (#299)\n\nWhen we read parquet Map types in delta-rs, the data gets read as\r\nrootname \"key_value\" and then the struct type has two fields \"key\",\r\n\"value\". We have casting logic that expects this schema, however when we\r\nconvert our snapshot.schema to an arrow schema, a mismatch happens\r\nbecause kernel is using other field names.\r\n\r\nError when we optimize tables with Map types.\r\n```python\r\nSchemaMismatchError: Could not find column keys\r\n```\r\n\r\nTheoretically arrow fields can use whatever names they want, but since\r\nwe are reading parquet data and therefore getting these RecordBatches\r\nwith that structure, it would be just much easier to keep the structure\r\nof the datatypes consistent between the two.\r\n\r\nSee parquet docs:\r\n\r\nhttps://github.com/apache/parquet-format/blob/master/LogicalTypes.md#maps","shortMessageHtmlLink":"fix: make Map arrow type consistent with Map parquet type (#299)"}},{"before":"2b6487687ed503af0668a675b8d7fb8e2e6b07de","after":"7fe738708ce3315e97b3e8077783054ee566f9b8","ref":"refs/heads/main","pushedAt":"2024-08-02T21:52:23.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"feat: typed table features (#222)\n\ndelta-kernel aiming to be a reference implementation of the protocol, I\r\nthought it might make sense to be explicit about what table features we\r\nknow about.\r\n\r\nThis has also proven quite useful in delta-rs when implementing various\r\nfeatures.","shortMessageHtmlLink":"feat: typed table features (#222)"}},{"before":"34957fabf8ac6db5f3e98fdc5b8bc5c77eeb7ba5","after":"2b6487687ed503af0668a675b8d7fb8e2e6b07de","ref":"refs/heads/main","pushedAt":"2024-08-02T18:26:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"Add a --limit option to read-table-multi-threaded (#297)\n\nArrow printing is actually _really_ slow, so for a big table it's useful\r\nto be able to just print a few rows and the total count, for testing, or\r\nto get a sense of how fast kernel","shortMessageHtmlLink":"Add a --limit option to read-table-multi-threaded (#297)"}},{"before":"ec934e804fa54fd977b7893ae011aa4dcc3875d9","after":"34957fabf8ac6db5f3e98fdc5b8bc5c77eeb7ba5","ref":"refs/heads/main","pushedAt":"2024-07-28T17:44:17.000Z","pushType":"pr_merge","commitsCount":4,"pusher":{"login":"zachschuermann","name":"Zach Schuermann","path":"/zachschuermann","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19472747?s=80&v=4"},"commit":{"message":"Merge pull request #289 from zachschuermann/typo-fix","shortMessageHtmlLink":"Merge pull request #289 from zachschuermann/typo-fix"}},{"before":"1258a8873ee7b9bd8dcb89ac67af9d1c38040727","after":"ec934e804fa54fd977b7893ae011aa4dcc3875d9","ref":"refs/heads/main","pushedAt":"2024-07-26T19:03:46.000Z","pushType":"pr_merge","commitsCount":23,"pusher":{"login":"hntd187","name":"Stephen Carman","path":"/hntd187","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6778339?s=80&v=4"},"commit":{"message":"Merge pull request #215 from hntd187/dv-utils\n\nfeat: better ways to use deletion vectors","shortMessageHtmlLink":"Merge pull request #215 from hntd187/dv-utils"}},{"before":"d345981fe0fedc109e9242a7d46aa199eea31d27","after":"1258a8873ee7b9bd8dcb89ac67af9d1c38040727","ref":"refs/heads/main","pushedAt":"2024-07-22T23:37:36.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"Update to dat 0.3 (#290)\n\n- Update to the latest version of DAT\r\n- Don't skip any tests\r\n\r\nThis requires some slight massaging of the expected data. In particular,\r\nsome of the expected timestamps are in zone `+00:00` which _is_ UTC\r\n([link](https://en.wikipedia.org/wiki/UTC%2B00:00)), so if we find that,\r\nwe just convert.\r\n\r\nThis requires going column-by-column and normalizing if needed. \r\n\r\nThis also removes the data_type check, since that actually needs to\r\nhappen after column normalization, and it does already happen as part of\r\nchecking if two columns are equal. See\r\n[here](https://arrow.apache.org/rust/arrow_data/equal/fn.equal.html).","shortMessageHtmlLink":"Update to dat 0.3 (#290)"}},{"before":"c838ed8a81cb506a4e53f8e34d039d2a396b77cb","after":"d345981fe0fedc109e9242a7d46aa199eea31d27","ref":"refs/heads/main","pushedAt":"2024-07-22T22:23:20.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"C ffi test with cmake (#288)\n\nMove to using the read-test example as an ffi-test.\r\n\r\nIncludes:\r\n- Redo how we print tables, since the old method was not deterministic\r\nenough\r\n- Some fixes to make things compile properly on macOS\r\n- Adding expected output for all_primitive_types and basic_partitioned\r\ntable\r\n- a test def for cmake so we can run `make test` after `cmake ..`\r\n- a `run_test.sh` script to actually run the test","shortMessageHtmlLink":"C ffi test with cmake (#288)"}},{"before":"94cc6faf26b1e6eebb81cf7e721c3cc28783beaf","after":"c838ed8a81cb506a4e53f8e34d039d2a396b77cb","ref":"refs/heads/main","pushedAt":"2024-07-19T19:47:43.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nicklan","name":"Nick Lanham","path":"/nicklan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/178912?s=80&v=4"},"commit":{"message":"Cleanup tests, run everything (except hdfs) (#284)\n\nMake sure our CI runs all the tests for the whole workspace.\r\n\r\nAlso fix some failing tests in `ffi` due to either mistakes in the doc\r\ncomment or slight compiler output changes.","shortMessageHtmlLink":"Cleanup tests, run everything (except hdfs) (#284)"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yNFQwMToxMjoxMS4wMDAwMDBazwAAAAS-lF-X","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0yNFQwMToxMjoxMS4wMDAwMDBazwAAAAS-lF-X","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wNy0xOVQxOTo0Nzo0My4wMDAwMDBazwAAAASEPDyC"}},"title":"Activity ยท delta-incubator/delta-kernel-rs"}