Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Updating wiki page for new season

Table of Contents

the webpage is out of date ans has to be updated (30.03.2023, Andreas Fehlner)


Overview

Below is an overview of the current discussion topics within the Trusted AI Committee. Further updates will follow as the committee work develops. 

  • Focus of the committee is on policies, guidelines, tooling and use cases by industry

  • Survey and contact current open source Trusted AI related projects to join LF AI & Data efforts 

  • Create a badging or certification process for open source projects that meet the Trusted AI policies/guidelines defined by LF AI & Data

  • Create a document that describes the basic concepts and definitions in relation to Trusted to Trusted AI and also aims to standardize the vocabulary/terminology

Mail List




Assets

 for

Meetings

    • for more information
listslfaidata




Meetingsg/trustedai-committee/calendar

Trusted AI Committee North America Monthly Meeting -   4th 1st Thursday of the month

  • 10 PM Shenzen China
,
  • 4 PM Paris
,
  • 10 AM ET
,
  • USA
  • 7 AM PT USA (updated for daylight savings time as needed)

Zoom info : https://zoom.us/j/7659717866
We will starting ONE Monthly Call for Europe/Asia Time Zone, every 2nd Thursday of the month (Starting in November - time to be determined)
Participants

Initial Organizations Participating: IBM, Orange, AT&T, Amdocs, Ericsson, TechM, Tencent




Committee Chairs

Name

Region

Organization

Email Address

LF ID

Animesh Singh

North

LinkedIn

Andreas Fehlner

Europe

TRUMPF Laser

fehlner@arcor.de 

https://www.linkedin.com/in/andreas-fehlner-60499971

Susan Malaika

America

IBM

singhan@us

malaika@us.ibm.com

Souad Ouali

Europe

Orange

souad.ouali@orange.com

Jeff Cao

Asia

Tencent

jeffcao@tencent.com

Susan Malaika 
(but different email address)

https://www.linkedin.com/in/susanmalaika

Suparna Bhattacharya

AsiaHPEsuparna.bhattacharya@hpe.com...https://www.linkedin.com/in/suparna-bhattacharya-5a7798b

Adrian Gonzalez Sanchez

Europe

HEC Montreal / Microsoft / OdiseIA

adrian.gonzalez-sanchez@hec.ca 

Adrian Gonzalez Sanchez(but different email address)

https://www.linkedin.com/in/adriangs86




Participants

Initial Organizations Participating: IBM, Orange, AT&T, Amdocs, Ericsson, TechM, TencentCommittee Participants


Name

Organization

 Email Address

LF ID

Ofer Hermoni

Amdocs 

oferher@gmail.com

Ofer Hermoni 

Mazin Gilbert

ATT 

mazin@research.att.com 

...

Alka Roy

Responsible Innovation Project

alka@responsibleproject.com 

...

Mikael Anneroth 

Ericsson

mikael.anneroth@ericsson.com 

...

Alejandro Saucedo

The Institute for Ethical AI and Machine Learning

a@ethical.institute

Alejandro Saucedo 

Jim Spohrer

IBM

 

spohrer@us.ibm.com

spohrer

Jim Spohrer 

Saishruthi Swaminathan

IBM

 

saishruthi.tn@ibm.com

Saishruthi Swaminathan 

Susan Malaika

IBM

 

malaika@us.ibm.com

sumalaika (but different email address)

Romeo Kienzler

IBM

romeo.kienzler@ch.ibm.com

Romeo Kienzler 

Francois Jezequel

Orange

francois.jezequel@orange.com 

Francois Jezequel 

Nat Subramanian

Tech Mahindra 

Natarajan.Subramanian@Techmahindra.com

Natarajan Subramanian 
 Han

Han Xiao

Tencent

 

hanhxiao@tencent.com

...

Wenjing Chu

Futurewei

chu.wenjing@gmail.com

Wenjing Chu

Yassi Moghaddam

ISSIP

yassi@issip.org

Assets

- All the assets being 




Sub Categories-

  • Fairness: Methods to detect and mitigate bias in datasets and models, including bias against known protected populations
-
  • Robustness: Methods to detect alterations/tampering with datasets and models, including alterations from known adversarial attacks
-
  • Explainability: Methods to enhance understandability/interpretability by persona/roles in process of AI model outcomes/decision recommendations, including ranking and debating results/decision options
-
  • Lineage: Methods to ensure provenance of datasets and AI models, including
reproducibility of
  • reproducibility of generated datasets and AI models




Projects

Working Groups

 Trusted AI Principles Working Group

 Trusted AI Technical Working Group

Meetings

Zoom info : Trusted AI Committee meeting - NA/Europe Meeting 4th Thursday of the month,  10 PM Shenzen China, 4 PM Paris, 10 AM ET, 7 AM PT USA (updated for daylight savings time as needed)
https://zoom.us/j/7659717866

How to Join: Visit the Trusted AI Committee Group Calendar to self subscribe to meetings.

Or email trustedai-committee@lists.lfaidata.foundation for more information. 

Meeting Content (minutes / recording / slides / other):




Meeting Content (minutes / recording / slides / other)


Date

Agenda/Minutes

 

Proposed agenda (ET)

  • 10am - Kick off Meeting
  • 10:05 - gap between AI act and recent GenAI developments - Adrian Gonzalez Sanchez
  • 10:15 - discussion
  • 10:30- formulate any next steps
  • 10:35 - news from the open source trusted ai  projects
  • 10:45 - any other business

Call Lead: Susan Malaika

 

Invitees: Beat Buesser; Phaedra Boinodiris ; Alexy Khrabov, David Radley, Adrian Gonzalez Sanchez

Optional: Ofer Hermoni , Nancy Rausch, Alejandro Saucedo, Sri Krishnamurthy, Andreas Fehlner, Suparna Bhattacharya

Attendees: Beat Buesser, Phaedra Boinodiris, Alexy Khrabov, Adrian Gonzalez Sanchez, Ofer Hermoni, Andreas Fehlne


Discussion

  • Phaedra - Consider : Large Language Models opportunity and risks - in the context trusted ai - how to mitigate risk -
  • Adrian: European Union AI Act https://artificialintelligenceact.eu/
  • Suparna -what does it mean foundation models in general, where language models is one example. Another related area is data centric trustworthy AI in this context
  • Alexy - Science - More work on understanding at the scientific way (e.g., Validation in Medical Context) - software engineering ad hoc driven by practice
  • Fast Forward - what’s next for ChatGPT

  • Andreas : File Formats for Models - additional needs for Trustworthy AI - in addition to Lineage
  • Idea: Create a PoV - Trustworthy AI for Generative application - Take AI ACT approach
  • Gaps in EU AT Act: https://venturebeat.com/ai/coming-ai-regulation-may-not-protect-us-from-dangerous-ai/ useful source


Next steps

  • Set up a series of calls through the LF-AI Trusted AI mechanisms to have the following presenters
  • Run 3 sessions with presentations
  • Then create a presentation and/or document
  • Create the synthesis -A Point of View on : Trustworthy AI for Generative Applications

  • Occasionally the open source project leaders are invited to the call …
  • ACTION: Adrian will schedule next meeting

 

Date

Agenda/Minutes

November 19, 2020

Recording (video)

Recording (audio)

Principles report  =(R)REPEATS

Recording (audio)

Recording (video)

LFAI Trusted AI Committee Structure and Schedule: Animesh Singh

Real World Trusted AI Usecase and Implementation in Financial Industry: Stacey Ronaghan

AIF360 Update: Samuel Hoffman

AIX360 Update: Vijay Arya

ART Update: Beat Buesser

October 1,  

 

Recording (audio)

Recording (video)

Setting up Trusted AI TSC

Principles Update

Coursera Course Update

Calendar discussion - Europe and Asia Friendly

Recording

Walkthrough of LFAI Trusted AI Website and github location of projects

Trusted AI Video Series

Trusted AI Course in collaboration with University of Pennsylvania

Recording

Z-Inspection: A holistic and analytic process to assess Ethical AI - Roberto Zicari - University of Frankfurt, Germany

Age-At-Home - the exemplar of TrustedAI, David Martin, Hacker in Charge at motion-ai.com

Plotly Demo with SHAP and AIX360 - Xing Han, Plot.ly



  • Explain the Tips dataset with SHAP: Article, Demo
  • Heart Disease Classification with AIX360: Post, Demo
  • Community-made SHAP-to-dashboard API: Post

Swiss Digital Trust Label - short summary - Romeo Kienzler, IBM

  • Announced by Swiss President Doris Leuthard at WEF 2nd Sept. 2019
  • Geneva based initiative for sustainable and fair treatment of data
  • Among others, those companies are involved already Google, Uber, IBM, Microsoft, Facebook, Roche, Mozilla, Booking.com, UBS, Credit Suisse, Zurich, Siemens IKRK,  EPFL,  ETH, UNO
  • Booking.com, Credit Suisse, IBM, Swiss Re, SBB, Kudelski and Canton of Waadt to deliver pilot

Agenda

Watson OpenScale and Trusted AI - Eric Martens, IBM

LFAI Ethics Training course 
https://github.com/lfai/ai-ethics-training/blob/master/ai-ethics-outline.md

recording

Recording:

View file
nameLFAI TAIC 20200723 Openscale and Video zoom_0.mp4
height250

slack

Agenda

  • Montreal AI Ethics Institute Presentation

  • Status on Trusted AI projects in Open Governance

Agenda

  • Principles Working Group update - Susan Malaika

  • Trusted AI Committee activities summarization for Governing board - Animesh Singh

Agenda

  • Swaminathan Chandrasekaran, KPMG Managing Director would be talking about how they are working with practitioners in the field on their AI Governance and Trusted AI needs.

  • Susan Malaika from IBM will be giving an update from the Principles Working Group, and progress there.

Agenda

  • Saishruthi Swaminathan to do a presentation on AI Transparency in Marketplace

  • Francois

Jezequel to
  • Jezequel to present on Orange Responsible AI initiative.

Agenda

  • Andrew and Tommy did a deep dive in Kubeflow Serving and Trusted AI Integration

  • Principles Working Group discussion

Proposed Agenda

  • AI for People is focused on the intersection of AI and Society with a lot of commonality with the

focus areas
  • focus areas of our committee. Marta will be joining to present their organization and what

they are
  • they are working on.

  • Proposal of Use Case to be tested by AT&T using Apache Nifi and AIF360  (romeo)

Proposed Agenda

  • Introduction to baseline data set for AI Bias detection (romeo)

  • Exemplar walk-through: retrospective bias detection with Apache Nifi and AIF360 (romeo)

  • Principles Working Group Status Update (Susan)

Proposed Agenda

Discuss AIF360 work around SKLearn community (Samuel Hoffman, IBM Research demo)

Discuss "Many organizations have principles documents, and a bit of backlash - for not enough practical examples."

Resource

  • Watch updates on production ML with Alejandro Saucedo done with Susan Malaika on the Cognitive Systems Institute call:
    Widget Connector
    urlhttps://www.youtube.com/watch?v=nuvRMFM8USE

Notes from the call:


Proposed Agenda

  • Meeting notes are now in GitHub here: https://github.com/lfai/trusted-ai/tree/master/committee-meeting-notes

  • Since we don't record and share our committee meetings should our committee channel in Slack be made private for asyncronous conversation outside these calls?

  • Introduction of MLOps  in IBM Trusted AI projects

  • Design thinking around integrating Trusted AI projects in Kubeflow Serving

Notes from the call:

 

https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191212.md

Proposed Agenda:

  • Jim to get feedback from LFAI Board meeting

  • Romeo to demo AIF360 -Nifi Integration + feedback from his talk at OSS Lyon

  • Alka to present AT&T Working doc

  • Discuss holiday week meeting potential conflicts (28 Nov - US Holiday, 26 Dec - Day after Christmas)

Notes from call:


https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191114.md

Attendees:

Ofer, Alka, Francois, Nat, Han, Animesh, Jim, Maureen, Susan, Alejandro

Summary

  • Animesh walked through the draft slides (to be presented in Lyon to LFAI governing board about TAIC)

  • Discussion of changes to make

  • Discussion of members, processes, and schedules

Detail

  • Jim will put slides in Google Doc and share with all participants

  • Susan is exploring a slack channel for communications

  • Trust and Responsibility, Color, Icons to add Amdocs, Alejandro's Institute

  • Next call Cancelled (31 October) as many committee members will be at OSS EU and TensorFlow World

Notes from the call:

https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191017.md

Attendees:

Animesh Singh (IBM), Maureen McElaney (IBM), Han Xiao (Tencent), Alejandro Saucedo, Mikael Anneroth (Eriksson), Ofer Hermoni (Amdocs)

Animesh will check with Souad Ouali to ensure Orange wants to lead the Principles working group and host regular meetings. Committee members on the call were not included in the email chains that occurred so we need to confirm who is in charge and how communication will occur.

The Technical working group has made progress but nothing concrete to report.

A possible third working group could form around AI Standards.

Notes from the call:

https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20191003.md

 

Attendees:


Ibrahim. H, Nat .S, Animesh.S, Alka.R, Jim.S, Francios. J, Jeff. C, Maureen. M, Mikael. A, Ofer. H, Romeo.K

  • Goals defined for the meeting:

Working Group Names and Leads have been confirmed:

  • Principles, lead: Souad Ouali (Orange France) with members from Orange, AT&T, Tech Mahindra, Tencent, IBM, Ericsson, Amdocs.
  • Technical, lead: Romeo Kienzler (IBM Switzerland) with members from IBM, AT&T, Tech Mahindra, Tencent, Ericsson, Amdocs, Orange.
  • Working groups will have a weekly meeting to make progress.  First read out to LF AI governing board will be Oct 31 in Lyon France.
  • The Principles team will study the existing material from companies, governments, and professional associations (IEEE), and some up with set that can be shared with the technical team for feedback as a first step.  We need to identify and compile the existing materials.
  • The Technical team is working on Acuomos+Angel+AIF360 integration demonstration.
3.

Possible Discussion about third working group

Discussion about LFAI day in Paris


More next steps

Will begin recording meetings in future calls.


Notes from call: https://github.com/lfai/trusted-ai/blob/master/committee-meeting-notes/notes-20190919.md