Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

All are welcome.

Table of Contents

Next meeting: April 13, 2023 (10am PT)

March 9, 2023 (10am PT)

Tentative agenda:

Attendees:

  • TSC:
    • Julien Le Dem, OpenLineage project lead
    • Minkyu Park, Senior Engineer, Astronomer
    • Michael Collado, Staff Engineer, Astronomer
    • Maciej Obuchowski, Software Engineer, GetInData, OpenLineage committer
    • Willy Lulciuc, Co-creator of Marquez, OpenLineage committer
    • Michael Robinson, Community team, Astronomer
    • Jakub Dardziński, Software Engineer, GetInData
    • Tomasz Nazarewicz, Software Engineer, GetInData
  • And:
    • Sam Holmberg, Senior Software Engineer, Astronomer
    • Brad, Fivetran
    • Prachi Mishra, Senior Software Engineer, Astronomer
    • Sheeri Cabral, Project Manager, Collibra
    • Anirudh Shrinivason, Data Engineer, Grab
    • Ann Mary Justine, Research Engineer, HP Enterprise's CMF team
    • John Thomas, Software Engineer, Dev. Rel., Astronomer
    • Atif Tahir, Data Engineer, Astronomer
    • Martin Foltin, Data Engineer, HP Enterprise's CMF team

Agenda:

  • Recent releases
  • Recent releases
  • Demo: a new OpenLineage consumer
  • Async operator support in Airflow
  • JDBC relations support in Spark
  • Discussion topics:
    • new feature idea: column transformations/operations in the Spark integration
    • the thinking behind namespaces
  • Open discussion

...