"On AI For Creativity" is a series of sharing sessions where we invite experts from various domains (tech, design, finance, education, art and entertainment, etc) to share ideas and work on AI x Creativity. Both online / in-person events will be hosted. In this very first online session, we had two Data Scientists in different fields to share with us on the same topic.
AI today can do so much: Composing art, music, writing, and even computer codes. The creative tasks that previously take human weeks and months to do, AI may now do so in mins. With the new billion dollar market enabled by Generative Technology, creative people needs to understand how AI-powered creativity works and prepare for its uprising. In this talk, we will discuss the history of development of Generative AI, obtain an intuitive understanding of the technology, its use cases, and how it may shape the future of the Web.
If fundamental technology (e.g., Generative Tech) can be proliferated:
Most transformer models are pre-trained with some language modeling objectives, and then followed by some fine-tuning steps with supervised training. Generative modeling offers a lot of advantages, it simplifies training by removing the fine-tuning steps, and it allows the model to perform many tasks without changing the architecture, eventually leading to models so powerful and with seemingly endless usage like ChatGPT. The key ingredient that separates ChatGPT from its predecessors is that it incorporated human feedback in the training process with Reinforcement Learning. In this talk, Julius discussed how this mechanism works, and the implications of it.