Knowledge Distillation with Helen Byrne

The rise of synthetic data with Florian Hönicke from Jina AI

January 29, 2024 Helen Byrne Season 1 Episode 4
The rise of synthetic data with Florian Hönicke from Jina AI
Knowledge Distillation with Helen Byrne
More Info
Knowledge Distillation with Helen Byrne
The rise of synthetic data with Florian Hönicke from Jina AI
Jan 29, 2024 Season 1 Episode 4
Helen Byrne

Data is the fuel that is powering the AI revolution - but what do we do when there's just not enough data to satisfy the insatiable appetite of new model training?

In this episode, Florian Hönicke, Principal AI Engineer at Jina AI, discusses the use of LLMs to generate synthetic data to help solve the data bottleneck. He also addresses the potential risks associated with an over-reliance on synthetic data. 

German startup Jina AI is one of the many exciting companies coming out of Europe, supporting the development and commercialisation of generative AI. 

The team at Jina AI gained widespread attention in late 2023 for the release of the first open-source text embedding model with an 8192 token length. Jina-embeddings-v2 achieves state-of-the-art performance on a range of embedding-related tasks and matches the performance of OpenAI's proprietary ada-002 model.

Watch the video of our interview: https://youtu.be/AP80hZajk5w


Show Notes

Data is the fuel that is powering the AI revolution - but what do we do when there's just not enough data to satisfy the insatiable appetite of new model training?

In this episode, Florian Hönicke, Principal AI Engineer at Jina AI, discusses the use of LLMs to generate synthetic data to help solve the data bottleneck. He also addresses the potential risks associated with an over-reliance on synthetic data. 

German startup Jina AI is one of the many exciting companies coming out of Europe, supporting the development and commercialisation of generative AI. 

The team at Jina AI gained widespread attention in late 2023 for the release of the first open-source text embedding model with an 8192 token length. Jina-embeddings-v2 achieves state-of-the-art performance on a range of embedding-related tasks and matches the performance of OpenAI's proprietary ada-002 model.

Watch the video of our interview: https://youtu.be/AP80hZajk5w