Utilizing Free AI Models with .NET Aspire
by DeeDee Walsh, on Feb 4, 2025 8:06:29 AM
Did you catch Santiago Arango from GAP at the "Best of .NET Conf" livestream with Jeff Fritz (@csharpfritz)? If not, you missed out on some seriously cool AI live coding.
Santiago geeked out in a big way demoing how .NET Aspire and AI work really well together. He showed us how to integrate AI tools and LLMs into our apps and even gave us a peek at using local environments to run everything without having to take out a loan (or needing a credit card).
One of the coolest takeaways was the ability to use free AI models from GitHub and Ollama. You didn't hallucinate that - it's free! No more excuses for not exploring the power of AI in your projects.
Santiago also showed us how to:
- Implement vector search to find specific information in large datasets
- Generate images with AI
- Deploy AI-powered applications to the Azure cloud
And the best part? He shared his code so you can try it out for yourself: https://github.com/CloudWorld-Tech/Dotnet9.AI.Extensions.Demo
Watch the full video and follow along with the code sample here:
P.S. Did you know that you can now run Ollama directly inside of .NET Aspire? It's pretty sweet stuff.