The OpenLineage Technical Steering Committee meetings are Monthly on the Second Thursday from 10:00am to 11:00am on the Second Wednesday from 9:30am to 10:30am US Pacific. Here's the meeting info.
All are welcome.
| Table of Contents |
|---|
Next meeting: May 8, 2024 (9:30am PT)
April 10, 2024 (9:30am PT)
Attendees:
- TSC:
...
- Julien Le Dem, OpenLineage project lead, LF AI & Data
- Michael Robinson, Community Manager, Astronomer
- Harel Shein, Lineage at Datadog
- And:
- Sheeri Cabral, Product Manager, ETL, Collibra
- Eric Veleker, Partnerships, Atlan
- Jens Pfau, Engineering Manager, Lineage, Google
- David Twaddell, Architect, HSBC
Agenda:
- Announcements
- Recent release highlights
- Discussion items
- supporting job-to-job dependencies in the spec
- improving naming conventions
- Open discussion
Meeting:
March 13, 2024 (9:30am PT)
Tentative agenda:
- Announcements
- Recent releasesrelease 1.9.1 highlights
- Scala 2.13 support in Spark overview by @Damien Hawes
- Circuit breaker in Spark & Flink, built-in lineage in Spark @Paweł Leszczyński
- Discussion items
- Open discussion
...
- Recent releases
- Announcements
- Proposal updates
- Open discussion
Meeting:
Widget Connector url http://youtube.com/watch?v=HW3Dd75UXLY
Widget Connector url http://youtube.com/watch?v=ozxLWjSOfiY
Widget Connector url http://youtube.com/watch?v=GN-ic0bjNoo
Notes:
Summary
1. Harel Shein provided announcements about upcoming meetups and shared metrics on community growth.
2. Harel Shein discussed the release of version 1.6.2, highlighting new features and bug fixes.
3. Harel Shein shared metrics on contributors and commits, showing an increase in both.
4. Jens Pfau presented two proposals for column-level lineage, focusing on transformation types and descriptions.
5. Mandy Chessell suggested including the name of the masking function as an additional property for masking transformations.
6. Harel Shein expressed appreciation for the proposals and encouraged community members to review and provide feedback.
7. Eric Veleker expressed gratitude for the momentum and adoption of open lineage, thanking the community for their hard work.
8. Harel Shein echoed Eric's sentiments and acknowledged the project's growth and industry standard status.
9. Harel Shein thanked all contributors and adopters for their contributions to the community.
...