Page History

...

Notes:

1. Announcements [Julien]
   1. Ecosystem Survey still needs responses: https://bit.ly/ecosystem_survey
   2. OpenLineage graduated from the LF AI on 7/27
   3. The 3rd issue of our monthly newsletter shipped on 7/31. Sign up here: https://bit.ly/OL_news
   4. Upcoming meetups:
      
      1. 8/30 in S.F. at Astronomer
      2. 9/18 in Toronto at Airflow Summit
      3. Marquez meetup on 10/5 in S.F.
2. LF AI Update [Michael R.]
   1. Topics covered by Julien in presentation to LF AI TAC for graduation included trends in adoption
3. Recent releases [Michael R.]

   1. 1.0.0: Added

      • Airflow: convert lineage from legacy File definition #2006@mobuchowski

      Removed

      • Spec: remove facet ref from core #1997@JDarDagran

      Changed

      • Airflow: change log level to DEBUG when extractor isn't found #2012@kaxil
      • Airflow: make sure we cannot fail in thread despite direct execution #2010@mobuchowski

      • https://github.com/OpenLineage/OpenLineage/releases/tag/1.0.0

        https://github.com/OpenLineage/OpenLineage/compare/0.30.1...1.0.0

   2. 0.30.1: Added

      • Flink: support Iceberg sinks #1960@pawel-big-lebowski
      • Spark: column-level lineage for merge into on delta tables #1958@pawel-big-lebowski
      • Spark: column-level lineage for merge into on Iceberg tables #1971@pawel-big-lebowski
      • Spark: add support for Iceberg REST catalog #1963@juancappi
      • Airflow: add possibility to force direct-execution based on environment variable #1934@mobuchowski
      • SQL: add support for Apple Silicon to openlineage-sql-java#1981@davidjgoss
      • Spec: add facet deletion #1975@julienledem
      • Client: add a file transport #1891@Alexkuva

      Changed

      • Airflow: do not run plugin if OpenLineage provider is installed #1999@JDarDagran
      • Python: rename config to config_class#1998@mobuchowski

      • https://github.com/OpenLineage/OpenLineage/releases/tag/0.30.1

        https://github.com/OpenLineage/OpenLineage/compare/0.29.2...0.30.1

July 13, 2023 (8am PT)

Attendees:

...