BITCON 2024

In the ever-evolving landscape of artificial intelligence, the ability to harness the power of Generative AI (Gen AI) locally or in the cloud offers unparalleled flexibility and privacy. This workshop aims to empower participants with the knowledge and skills to run Gen AI software using readily available resources while ensuring their data remains private and secure.

The workshop will begin with a brief lecture covering the primary goals: understanding the importance of self-hosted AI, exploring various models and their applications, and the essential resources needed to get started.

Following the lecture, we will transition into a hands-on demonstration of the step-by-step process of setting up a Gen AI system on a local laptop, including model download using Ollama and web interface setup with open-webui. The demonstration will continue with deploying a similar setup in AWS, discussing both managed services and user-managed servers.