KISZ Guest Talks

Democratizing and Productionizing LLMs

Date: May 17, 2023
Language: English
Duration: 01:19:45
The KI Service Center @HPI is honored to announce the first KISZ talk by Matei Zaharia. Matei is an associate professor at Stanford CS, where he works on computer systems and machine learning as part of the Stanford DAWN Project. He also co-founded and is the Chief Technologist of Databricks, a data and AI platform startup.

Background: The effort to democratize large language models aims to expand access and usage of these complex neural networks to a wider audience. Dolly 2.0 is the first open-source, instruction-following LLM, fine-tuned on a human-generated instruction dataset licensed for research and commercial use. Databricks are open-sourcing Dolly 2.0 in its entirety, including the training code, the dataset, and the model weights; its licence is suitable for commercial use. Hence, any organisation can create, own, and customise powerful LLMs that can talk to people, without paying for API access or sharing data with third parties.

CoCoFL: Communication- and Computation-Aware Federated Learning via Partial NN Freezing and Quantization“

Date: July 27, 2023
Language: English
Duration: 01:25:11