...
- Announcements [Julien]:
- Our first annual ecosystem survey is live and accepting responses: https://bit.ly/ecosystem_survey. Your participation matters!
- We recently published the first issue of our monthly newsletter: https://mailchi.mp/18826f97904e/openlineage-news-may-2023. It's a great way to learn about upcoming meetups and recent blog posts, etc.
- Two meetups are happening soon:
- New York on 6/22 at Collibra's HQ: https://www.meetup.com/data-lineage-meetup/events/294065396/
- San Francisco on 6/27 at Astronomer: https://www.meetup.com/meetup-group-bnfqymxe/events/293448130/
- Upcoming talks:
- Paweł Leszczyński and Maciej Obuchowski, “Column Lineage is Coming to the Rescue,” Berlin Buzzwords, June 18-20, 2023
- Julien Le Dem and Willy Lulciuc, “Cross-platform Data Lineage with OpenLineage,” Data+AI Summit, June 28-29, 2023
- Maciej Obuchowski, “OpenLineage in Airflow: A Comprehensive Guide,” Airflow Summit, September 19-21, 2023
- Recent releases [Michael R.]:
- OpenLineage 0.25.0
- Added
- Spark: add Spark/Delta merge into support #1823 @pawel-big-lebowski
- https://github.com/OpenLineage/OpenLineage/releases/tag/0.25.0
- https://github.com/OpenLineage/OpenLineage/compare/0.24.0...0.25.0
- Added
- OpenLineage 0.26.0
- Added
- Proxy: Fluentd proxy support (experimental) #1757 @pawel-big-lebowski
- Changed
- Python client: use Hatchling over setuptools to orchestrate Python env setup #1856 @gaborbernat
- https://github.com/OpenLineage/OpenLineage/releases/tag/0.26.0
- https://github.com/OpenLineage/OpenLineage/compare/0.25.0...0.26.0
- Added
- OpenLineage 0.27.1
- Added
- Python client: add emission filtering mechanism and exact, regex filters #1878 @mobuchowski
- https://github.com/OpenLineage/OpenLineage/releases/tag/0.27.1
- https://github.com/OpenLineage/OpenLineage/compare/0.26.0...0.27.1
- Added
- OpenLineage 0.27.2
- Fixed
- Python client: deprecate client.from_environment, do not skip loading config #1908 @mobuchowski
- https://github.com/OpenLineage/OpenLineage/releases/tag/0.27.2
- https://github.com/OpenLineage/OpenLineage/compare/0.27.1...0.27.2
- Fixed
- OpenLineage 0.25.0
- Static Lineage Progress Update [Paweł]:
May 11, 2023 (10am PT)
Attendees:
...