Skip to content
/ Awesome-Generative-AI Public template

A repository dedicated to showcasing and exploring the fascinating world of generative artificial intelligence.

generative-ai-hub.gitbook.io/awesomegenerativeai/

License

MIT license
24 stars 5 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

natnew/Awesome-Generative-AI

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

87 Commits
.github/ISSUE_TEMPLATE
.github/ISSUE_TEMPLATE
 
 
data
data
 
 
image
image
 
 
.gitignore
.gitignore
 
 
Contributing.md
Contributing.md
 
 
Events.md
Events.md
 
 
LICENSE
LICENSE
 
 
LINK_TO_ADDITIONAL_RESOURCES.md
LINK_TO_ADDITIONAL_RESOURCES.md
 
 
LINK_TO_CONTRIBUTION_GUIDELINES.md
LINK_TO_CONTRIBUTION_GUIDELINES.md
 
 
LINK_TO_DETAILED_SECTION.md
LINK_TO_DETAILED_SECTION.md
 
 
LINK_TO_EDUCATIONAL_RESOURCES.md
LINK_TO_EDUCATIONAL_RESOURCES.md
 
 
LINK_TO_FEATURED_PROJECTS_SECTION.md
LINK_TO_FEATURED_PROJECTS_SECTION.md
 
 
LINK_TO_FORUM.md
LINK_TO_FORUM.md
 
 
LINK_TO_GALLERY.md
LINK_TO_GALLERY.md
 
 
LINK_TO_INTERACTIVE_EXPERIENCES.md
LINK_TO_INTERACTIVE_EXPERIENCES.md
 
 
LINK_TO_SETUP_GUIDE.md
LINK_TO_SETUP_GUIDE.md
 
 
Projects.md
Projects.md
 
 
README.md
README.md
 
 
Resources.md
Resources.md
 
 
Workflow.md
Workflow.md
 
 

Repository files navigation

Awesome-Generative-AI

Visit the Website

Banner Image

Recently Added

🆕 Last updated: January 2025

Resource Category Description
LangGraph Agent Frameworks Stateful multi-agent orchestration
Inspect AI Evaluation UK AISI's open-source eval framework
DSPy Frameworks Programming (not prompting) LLMs
Pydantic AI Agent Frameworks Type-safe, model-agnostic agents
RAGAS Evaluation RAG pipeline evaluation

Static Badge Static Badge

Created by NatNew and Contributors

About

Awesome-Generative-AI is your go-to open source repository for exploring the dynamic and creative world of generative artificial intelligence. From AI-generated art to innovative applications in various domains, this repository offers a wealth of resources, projects, and inspiration. Project Roadmap

Contents

Contents

Introduction

↑ Back to top

Generative AI is not just about technology; it's about the art of the possible. In this section, we delve into the vision, scope, and potential of generative AI. Learn about our community and how you can be a part of this exciting journey.

More about our vision

Getting Started

↑ Back to top

New to generative AI? No worries! Our step-by-step guide will help you set up your environment and start exploring the world of AI-driven creativity.

Start your journey here

What is Generative AI?

↑ Back to top

What is Generative AI?

Link Preview
What is generative AI? - McKinsey & Company Generative artificial intelligence (AI) describes algorithms (such as ChatGPT) that can be used to create new content, including audio, code, images, text, simulations, and videos. Recent breakthroughs in the field have the potential to drastically change the way we approach content creation.
What is generative AI? - Gartner Generative AI can learn from existing artifacts to generate new, realistic artifacts (at scale) that reflect the characteristics of the training data but don’t repeat it. It can produce a variety of novel content, such as images, video, music, speech, text, software code and product designs.
What is Generative AI? - Nvidia Generative AI enables users to quickly generate new content based on a variety of inputs. Inputs and outputs to these models can include text, images, sounds, animation, 3D models, or other types of data.
What Is Generative AI: A Super-Simple Explanation Anyone Can Understand- Forbes The term AI, as it's used today, refers to computer algorithms that can effectively simulate human cognitive processes - learning, decision-making, problem-solving, and even creativity.
The Turing Lectures: What is generative AI? Generative AI refers to a type of artificial intelligence that involves creating new and original data or content. Unlike traditional AI models that rely on large datasets and algorithms to classify or predict outcomes, generative AI models are designed to learn the underlying patterns and structure of the data and generate novel outputs that mimic human creativity.

Featured Projects

↑ Back to top

Dive into our curated collection of the most innovative and inspiring generative AI projects. Each project comes with a comprehensive description, source codes, and insights.

Explore Featured Projects

Interactive Experiences

↑ Back to top

Experience AI like never before with our interactive demos. Play around with AI models, create your art, music, or text, and see the magic unfold in real time.

Get Interactive

Educational Resources

Whether you're a beginner or an advanced learner, our collection of tutorials, guides, and resources will help you deepen your understanding of generative AI.

Learn More

↑ Back to top

Community Contributions

↑ Back to top

Your creativity can inspire many! Learn how you can contribute to this repository, and check out the amazing work done by our community.

Contribute Now

Art and Media Gallery

↑ Back to top

Enter our virtual gallery showcasing a mesmerizing array of AI-generated art and media. Be inspired and perhaps contribute your masterpiece!

Visit the Gallery

Discussions and Support

↑ Back to top

Got questions? Need help? Join our vibrant community in discussions, Q&A sessions, and get all the support you need for your generative AI journey.

Join the Discussion

Additional Resources

↑ Back to top

Explore more! Here's a list of additional resources, tools, communities, and reading materials to fuel your curiosity and knowledge in generative AI.

Discover More

Infographics

Preview Description
The three requirements of a successful generative AI model.
The diagram shows possible generative AI use cases within each category.
AI models that prioritize similarity falter when asked to design something completely new.
Generative learning trilemma
What Can Transformer Models Do?
MoE Means More for Transformers

Awesome Generative AI List

Agent Building Platforms

Platforms for building, deploying, and managing AI agents at scale.

Platform Provider Best For Key Features
Microsoft Copilot Studio Microsoft Enterprise agents Low-code, M365 integration, multi-agent orchestration
OpenAI Assistants API OpenAI Custom GPT agents Code interpreter, retrieval, function calling
Google Vertex AI Agent Builder Google Enterprise search & agents Grounding, RAG, Google Cloud integration
Amazon Bedrock Agents AWS AWS-integrated agents Knowledge bases, action groups, guardrails
Azure AI Agent Service Microsoft Azure-native agents Enterprise security, Azure integration
Salesforce Agentforce Salesforce CRM agents Sales, service, marketing automation
LangGraph Platform LangChain Custom agent workflows Stateful graphs, human-in-loop, LangSmith
Relevance AI Relevance AI No-code agents Visual builder, tool library
Voiceflow Voiceflow Conversational agents Visual design, multi-channel
Botpress Botpress Open-source agents Self-hostable, visual flow builder

Microsoft Copilot Ecosystem Clarification:

Product What It Is Target User
Microsoft Copilot (consumer) ChatGPT-like assistant General public
Microsoft 365 Copilot AI in Word, Excel, Teams, etc. Enterprise users
Microsoft Copilot Studio Platform for building custom agents Developers, makers
GitHub Copilot AI code completion Developers
Copilot+ PC Hardware with local AI Consumers

⬆ back to top

AI-Native IDEs & Code Editors

Development environments with deeply integrated AI assistance.

IDE Description AI Features Pricing
Cursor VS Code fork with native AI Tab completion, chat, codebase Q&A, agent mode Free tier available
Windsurf AI-native IDE by Codeium Flows, cascades, multi-file edits Free tier available
Zed High-performance collaborative editor AI assistant, inline edits Free (open source)
JetBrains AI Assistant AI in IntelliJ ecosystem Code completion, chat, refactoring Subscription
Visual Studio + Copilot Microsoft's full IDE GitHub Copilot integration Free tier available
VS Code + Copilot Lightweight editor GitHub Copilot, extensions Free
Replit Browser-based IDE Ghostwriter AI, deployment Free tier available
GitHub Codespaces Cloud dev environments Copilot, pre-configured Free tier (60 hrs/mo)
Amazon CodeCatalyst AWS dev environment CodeWhisperer integration Free tier available

IDE Extensions:

Extension For Description
GitHub Copilot VS Code, JetBrains, Neovim AI pair programmer
Codeium 70+ editors Free AI code completion
Tabnine Most editors Privacy-focused completion
Continue VS Code, JetBrains Open-source AI assistant
Cody VS Code, JetBrains Codebase-aware assistant

⬆ back to top

AI Safety & Red Teaming
Tool Description
PyRIT Microsoft's Python Risk Identification Tool for generative AI
Garak LLM vulnerability scanner
Adversarial Robustness Toolbox Python library for ML security - evasion, poisoning, extraction
AI Village CTF Capture the flag challenges at DEFCON
SAIF Google's guide to Secure AI Framework
TrojAI Security AI security research channel
AVID AI Vulnerability Database
NIST AI NIST AI risk management framework
AI Security Institute (AISI) UK government AI safety research
PortSwigger Web Security Web application security training

⬆ back to top

Articles

↑ Back to top

Audio - Voice Generators
  • Replica - AI-powered voice generator for producing voice lines.
  • Speechify - Text-to-speech reader with natural-sounding voice.
  • Murf - Offers studio-quality voice for presentations and podcasts.
  • Play.ht - AI Voice Generator for realistic Text to Speech audio.

⬆ back to top

Automation Tools

⬆ back to top

Best Practices

Guidelines for building secure, maintainable, and production-ready AI systems.

Security:

Practice Description Resources
Input validation Sanitize and validate all user inputs OWASP LLM Top 10
Prompt injection defense Guard against instruction hijacking Rebuff, LLM Guard
Output filtering Scan outputs for sensitive data, harmful content Guardrails AI, NeMo Guardrails
API key management Never commit keys, use secrets managers Azure Key Vault, AWS Secrets Manager
Rate limiting Protect against abuse and cost overruns API gateway policies
Audit logging Track all AI interactions LangSmith, Langfuse

GitHub Hygiene:

Practice Why How
.gitignore for AI Exclude model weights, API keys, caches gitignore.io
Pre-commit hooks Catch secrets before commit pre-commit, detect-secrets
Dependency scanning Identify vulnerabilities Dependabot, Snyk
Branch protection Require reviews for main GitHub branch rules
Signed commits Verify authorship GPG signing
CODEOWNERS Define ownership .github/CODEOWNERS

Testing AI Systems:

Test Type Purpose Tools
Unit tests Test individual components pytest, unittest
Integration tests Test tool/API interactions pytest, responses
Evaluation tests Measure model quality DeepEval, RAGAS
Regression tests Catch quality degradation PromptFoo
Red team tests Find adversarial failures Garak, PyRIT
Load tests Verify performance at scale Locust, k6

Production Checklist:

  • Implement graceful degradation (fallbacks when AI fails)
  • Set token/cost budgets per request
  • Add request timeouts
  • Cache repeated queries
  • Monitor latency, errors, costs
  • Implement circuit breakers for external calls
  • Log trajectories for debugging
  • Set up alerts for anomalies
  • Document failure modes
  • Plan for model deprecation

⬆ back to top

Books

Essential reading for understanding generative AI foundations, applications, and implications.

Foundations & Technical:

Title Author Focus
Designing Machine Learning Systems Chip Huyen Production ML systems design
Build a Large Language Model (From Scratch) Sebastian Raschka LLM architecture and training
Natural Language Processing with Transformers Lewis Tunstall, Leandro von Werra, Thomas Wolf Hugging Face ecosystem
Generative Deep Learning David Foster VAEs, GANs, Transformers
Deep Learning Ian Goodfellow, Yoshua Bengio, Aaron Courville Foundational deep learning theory
Hands-On Large Language Models Jay Alammar, Maarten Grootendorst Practical LLM applications

AI Safety & Ethics:

Title Author Focus
Human Compatible Stuart Russell Value alignment problem
The Alignment Problem Brian Christian Survey of AI safety challenges
Superintelligence Nick Bostrom Long-term AI risks
AI Ethics Mark Coeckelbergh Philosophical foundations
Weapons of Math Destruction Cathy O'Neil Algorithmic bias and harm
Atlas of AI Kate Crawford Political economy of AI

Strategy & Business:

Title Author Focus
Co-Intelligence Ethan Mollick Living and working with AI
The Coming Wave Mustafa Suleyman AI and synthetic biology futures
AI Superpowers Kai-Fu Lee US-China AI competition
Prediction Machines Ajay Agrawal, Joshua Gans, Avi Goldfarb Economics of AI

⬆ back to top

Bot Building Tools
  • Botpress - Open-source conversational AI platform.
  • Pandorabots - Platform for building and deploying chatbots.
  • Rasa - Open-source machine learning framework for automated text and voice-based conversations.
  • ManyChat - Visual bot builder for Facebook Messenger with broadcasts, analytics, scheduled posting, and many other features.
  • Chatfuel - A leading chatbot platform for Messenger.
  • Botsify - A simple way to build AI chatbots for websites.
  • Wit.ai - Voice-activated interface for apps.
  • Botkit - A toolkit for making bot applications.

⬆ back to top

Command Line Tools

CLI tools for interacting with AI models and building AI-powered workflows.

Tool Provider Description Install
Claude CLI Anthropic Chat with Claude from terminal npm install -g @anthropic-ai/claude-cli
Gemini CLI Google Interact with Gemini models npm install -g @anthropic-ai/gemini-cli
OpenAI CLI OpenAI GPT models from command line pip install openai
Aider Open Source AI pair programming in terminal pip install aider-chat
LangChain CLI LangChain Scaffold and manage LangChain projects pip install langchain-cli
LlamaIndex CLI LlamaIndex Build and query indices pip install llama-index
Ollama Ollama Run open models locally curl -fsSL https://ollama.ai/install.sh | sh
Simon Willison's LLM Open Source Access multiple LLMs from CLI pip install llm
Fabric Open Source AI prompts and patterns library pip install fabric-ai
sgpt Open Source Shell-GPT for command line pip install shell-gpt
Warp AI Warp AI-native terminal Desktop app
GitHub CLI + Copilot GitHub Copilot in the terminal gh extension install github/gh-copilot

⬆ back to top

Cloud Platforms and Virtual Agents
  • Amazon SageMaker - A fully managed machine learning service by AWS, streamlining the entire machine learning workflow.
  • Google AI Cloud Platform - Offers a suite of cloud-based tools and services for AI and ML applications.
  • Microsoft Azure AI - Provides a range of pre-built AI models and integrates with Azure services.
  • Salesforce Einstein AI Cloud - Enhances CRM and intelligent decision-making with AI and ML.
  • IBM Watson - Known for its cognitive computing capabilities and wide range of AI services.
  • Oracle Cloud AI - Offers AI and ML services, including predictive analytics and chatbots

⬆ back to top

Code Analysis Tools
  • ESLint - A pluggable and configurable linter tool for identifying and reporting on patterns in JavaScript.
  • FindBugs - A program to find bugs in Java programs.
  • Coverity - Offers static code analysis to identify software defects.
  • Black Duck - Helps developers and security professionals manage open-source security, license compliance, and code quality risks.
  • JSHint - A tool that helps to detect errors and potential problems in your JavaScript code.
  • Pylint - A tool that helps to detect errors and potential problems in your JavaScript code.
  • RuboCop -A Python static code analysis tool.
  • StyleCop - A Ruby static code analysis and formatting tool.
  • StyleCop -Analyzes C# source code to enforce a set of style and consistency rules.

⬆ back to top

Code Generators
  • Tabnine - AI code generator offering context-based code completions.
  • K-Explorer - Provides code snippet recommendations and enterprise code analysis.
  • PyCharm - Offers features like syntax highlighting, code formatting, and error-highlighting.
  • OpenAI Codex - Trained on GitHub repositories, assists in coding in multiple languages.
  • Cursor - AI-native code editor with built-in assistant.
  • Codeium - Free AI code completion for multiple IDEs.
  • Aider - CLI pair programming tool for terminal-based coding.
  • Continue - Open-source AI coding assistant, extensible.

⬆ back to top

Collaboration Tools
  • Dropbox - File hosting service offering personal cloud, file synchronization, cloud storage, and client software.
  • Confluence by Atlassian - Content collaboration tool used to help teams collaborate and share knowledge efficiently.
  • Trello - Web-based Kanban-style list-making application.
  • Miro - Online collaborative whiteboarding platform to bring teams together, anytime, anywhere.
  • Evernote - App designed for note taking, organizing, task management, and archiving.
  • Flock - A communication app for teams.
  • Mural - Digital workspace for visual collaboration.

⬆ back to top

Co-Pilot Tools
  • Tabnine - Code completion tool powered by machine learning.
  • Codeguru by AWS - Automated code review and performance profiling tool.
  • DeepCode - AI-based code review tool.
  • Codota - AI pair programmer to help you write better code.
  • IntelliCode by Microsoft - AI-assisted code completion tool.
  • Sourcegraph - Universal code search tool.
  • Klocwork - Static code analysis and SAST tool.
  • ReSharper by JetBrains - An extension for Microsoft Visual Studio that provides on-the-fly code analysis and eliminates errors in C#, VB.NET, XAML, ASP.NET, and XML.

⬆ back to top

Customer Support

⬆ back to top

Cybersecurity & OSINT Tools

Frameworks & Databases:

Tools:

Learning:

⬆ back to top

Data Science and Analysis Tools
  • MATLAB - A high-level language and interactive environment for numerical computation, visualization, and programming.
  • Apache Spark - An open-source distributed general-purpose cluster-computing framework.
  • SAS - Statistical software suite developed by SAS Institute for data management, advanced analytics, multivariate analysis, business intelligence, and predictive analytics.
  • IBM SPSS Statistics - Software package used for interactive, or batched, statistical analysis.
  • Anaconda - A distribution of the Python and R programming languages for scientific computing.
  • Tableau Public - Free software that can allow anyone to connect to a spreadsheet or file and create interactive data visualizations for the web.
  • KNIME - A free and open-source data analytics, reporting, and integration platform.
  • Domo - A cloud software company specializing in business intelligence tools and data visualization.

⬆ back to top

Deep Learning and Neural Network Tools
  • Chainer - Chainer: A flexible framework for neural networks, particularly powerful for research and development.
  • ONNX (Open Neural Network Exchange) - ONNX (Open Neural Network Exchange): An open ecosystem for interchangeable AI models.
  • Seldon - Seldon: An open-source platform for deploying machine learning models in Kubernetes.
  • Deeplearning4j - Deeplearning4j: An open-source deep-learning library for the Java Virtual Machine.
  • Neuroph - Neuroph: A lightweight Java neural network framework.

⬆ back to top

Design Generators
  • Khroma - AI color tool for designers, offering color discovery and selection.
  • Uizard - Enables rapid design of interfaces and conversion of screenshots to mockups.
  • Colormind - AI-powered color scheme generator learning from art and photos.
  • Designs.ai - Helps users create designs and logos without technical expertise.
  • Fronty AI - Converts images to HTML CSS for website design.

⬆ back to top

Ethics and Society
  • Future of Life Institute - Focuses on existential risks facing humanity, particularly artificial intelligence.
  • The Partnership on AI - A partnership between major tech companies and non-profits for the responsible development of AI.
  • AI Now Institute -Researches the social implications of artificial intelligence.
  • Ethics in AI Research Initiative by Google - A program to support research on responsible AI development.
  • Center for AI and Digital Policy (CAIDP) - Promotes a better society through responsible AI and digital policy.
  • Ethical AI Toolkit - A toolkit to help incorporate ethical considerations in AI development.
  • AI Ethics Lab - Provides practical tools and methods for integrating ethics into AI research and development.
  • Deon - A command-line tool that allows data scientists and developers to easily add ethical considerations checklists to their projects.
  • Ethics Canvas - A framework for exploring the ethical impact of AI technologies.
  • Ought - A tool for experimenting with mechanisms for delegating open-ended cognitive work to AI.
  • Women in AI Ethics - Community of women who are leaders in the AI ethics industry.

⬆ back to top

Evaluation Frameworks
Tool Focus Description
Inspect AI General evaluation UK AISI's open-source task-based eval framework
HELM Holistic evaluation Stanford's comprehensive LLM benchmarks
LM Evaluation Harness Benchmark suite EleutherAI's 200+ task evaluation framework
DeepEval LLM testing Unit tests and CI/CD for LLM apps
RAGAS RAG evaluation Retrieval quality and answer relevance metrics
TruLens App evaluation Feedback functions for groundedness and relevance
PromptFoo Prompt testing CLI-based prompt evaluation and comparison
Giskard ML testing Bias and robustness testing
OpenAI Evals Eval framework OpenAI's evaluation framework

⬆ back to top

Frameworks and Models
  • TensorFlow - Developed by the Google Brain team, this open-source AI library is used for machine learning and deep neural network research.
  • Sci-kit Learn - A Python library for machine learning tasks like classification, regression, and clustering.
  • Pandas - A data analysis and manipulation library known for its comprehensive data manipulation tools.
  • NumPy - Supports large, multi-dimensional arrays and matrices, with a vast collection of high-level mathematical functions.
  • PyTorch - Developed by Facebook's AI Research lab, this is a dynamic computational graph-based AI framework.
  • Keras - An open-source neural network library acting as an interface for TensorFlow and Theano.
  • Theano - A library for numerical computation, particularly efficient for numerical tasks.
  • Google ML Kit - A mobile SDK that brings Google's machine learning to Android and iOS apps.
  • Caffe 2 - A deep learning framework developed by Facebook.
  • Microsoft CNTK - A deep learning framework known for its efficiency at scale.
  • PraisonAI - Production-ready Multi-AI Agents framework with self-reflection, 100+ LLM support, MCP integration, and agentic workflows.
  • JAX - Composable transformations and XLA compilation for high-performance ML.
  • Hugging Face Transformers - State-of-the-art NLP models and pipelines.

⬆ back to top

Frameworks & Orchestration
Tool Description Key Features
LangChain LLM application framework Chains, memory, tool integration
LangGraph Stateful multi-agent orchestration Cycles, persistence, human-in-the-loop
LlamaIndex Data framework for LLM apps Indexing, retrieval, query engines
CrewAI Role-playing agent orchestration Agent roles, delegation, collaboration
AutoGen Multi-agent conversation framework Conversational patterns
DSPy Programming (not prompting) LLMs Optimizers, signatures, modules
Semantic Kernel LLM integration SDK Plugins, planners, memory
Haystack End-to-end NLP framework Pipelines, document stores
Pydantic AI Type-safe agent framework Model-agnostic, structured outputs

⬆ back to top

GitHub Repositories & Code Examples

⬆ back to top

GUIs
  • Tableau - A powerful business intelligence and data visualization tool.
  • Power BI - A Microsoft tool that turns data into visual insights.
  • QlikView - Business intelligence and visualization software.
  • Dataiku - Collaborative data science platform with a user-friendly GUI.
  • RapidMiner - Data science platform that includes a robust GUI.
  • Alteryx - Blends data science and analytics for deeper insights.
  • Talend - Data integration and data integrity with a graphical interface.
  • D3.js - JavaScript library for producing dynamic, interactive data visualizations in web browsers.

⬆ back to top

Guides
  • DEV Community - It covers setting up the environment, understanding generative models, and building a simple Generative Adversarial Network (GAN) with a focus on image datasets.
  • Flan- Scaling Instruction-Finetuned Language Models
  • ChatGPT - ChatGPT Prompt Engineering
  • LLaMA- LLaMA: Open and Efficient Foundation Language Models
  • GPT-4 - Prompt engineering techniques for GPT-4, including tips, applications, limitations, and additional reading materials.
  • Mistral - Mistral 7B is a 7-billion-parameter language model released by Mistral AI.
  • Gemini - Getting Started with Gemini
  • Phi-2 - Overview of the Phi-2, a 2.7 billion parameter language model.
  • LLM Collection - This section consists of a collection and summary of notable and foundational LLMs.

⬆ back to top

HR and Recruiting

⬆ back to top

Image Design

⬆ back to top

Journals and Publications

⬆ back to top

Languages
  • Java - Popular for its portability across platforms.
  • C++ - Known for its efficiency and control over system resources.
  • JavaScript - Widely used in web development, now increasingly for AI as well.
  • LISP - One of the oldest programming languages, historically popular in AI.
  • Prolog - Notable for its role in computational linguistics and AI.
  • Scala - Combines functional and object-oriented programming, useful in big data.
  • Julia - Known for high-performance numerical analysis and computational science
  • Swift - KApple's programming language, growing in AI for app development.

⬆ back to top

Learning Platforms

Structured learning paths and certifications for AI skills.

Platform Focus Cost
Google Cloud Skills Boost GCP, Gemini, Vertex AI Free + paid labs
Microsoft Learn Azure AI, Copilot, M365 Free
DeepLearning.AI ML/AI courses by Andrew Ng Free + paid
Coursera ML/AI Specializations University courses Subscription
fast.ai Practical deep learning Free
Hugging Face Learn NLP, Transformers, Diffusion Free
OpenAI Academy Prompt engineering, APIs Free
LangChain Academy LangChain, LangGraph Free
AWS Skill Builder AWS AI services Free + paid
DataCamp Data science, ML Subscription
Kaggle Learn ML, Python, SQL Free
Full Stack LLM Bootcamp Production LLM apps Free
Weights & Biases Courses MLOps, LLMs Free
Cohere LLM University NLP fundamentals Free

⬆ back to top

Machine Learning Deployment and MLOps Tools
  • Kubeflow - An open-source project dedicated to making deployments of machine learning workflows on Kubernetes simple, portable, and scalable.
  • MLServer - An open-source inference server to serve machine learning models in production.
  • Tecton - A data platform for machine learning, providing an easy way to build and deploy features for real-time machine learning models.
  • Polyaxon - A platform for reproducible and scalable machine learning and deep learning on Kubernetes.
  • Valohai - A deep learning management platform that automates machine learning infrastructure on any cloud or on-premises.

⬆ back to top

Miscellaneous Tools
Link Description
SingSong We present SingSong, a system which generates instrumental music to accompany input vocals, potentially offering musicians and non-musicians alike an intuitive new way to create music featuring their own voice.
AI21labs Build generative AI applications that solve today's business challenges, powered by AI21's state-of-the-art foundation and task-specific models.
HuggingFace AI Community Host and collaborate on unlimited models, datasets and applications.
DeepSpeed DeepSpeed is an easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for DL Training and Inference.
Eleuther.ai Empowering Open-Source Artificial Intelligence Research
Chainer.org A Powerful, Flexible, and Intuitive Framework for Neural Networks
Kubeflow The Machine Learning Toolkit for Kubernetes
Ainow The AI Now Institute produces diagnosis and actionable policy research on artificial intelligence.
Microsoft responsible-ai-toolbox About Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems.
Trulens Evaluate, iterate faster, and select your best LLM app with TruLens.
Jailbreak Chat Your weekly report on all things AI and language models. Read by over 10,000 others at places like at Google, Tesla, Microsoft, a16z, and more.
ETHICAL INTELLIGENCE Elevating the human in the equation
Purple Llama An umbrella project featuring open trust and safety tools and evaluations meant to level the playing field for developers to responsibly deploy generative AI models and experiences in accordance with best practice
Oxa Self-driving software and services that unlock the power of autonomy.
Deeprender.ai Developing the next generation of compression technology using AI, we’re here to completely rethink, reshape and revolutionise what’s possible.
Papercup We use data from real actors to produce voices so real that audiences can’t tell them apart from the real thing.
Onfido Create trust at onboarding and beyond with a complete, AI-powered digital identity solution built to help you know your customers online.
Quantexa Protect, optimize, and grow your organization with the power of Quantexa’s Decision Intelligence Platform and outcome-driven solutions.
Synthesia Our AI Video Generator enables everyone to create professional videos without mics, cameras, actors or studios.
Causalens.com Gain insights into Causal AI from blogs, white papers, case studies, webinars, and more.
Robina The AI Copilot for your Contracts
PhysicsX We are building AI and simulation engineering technologies to reinvent the design and operation of machines and products in advanced industries, with a strong focus on applications impacting the climate and human health.
Pitch Pitch is the fastest way for your team to create and share beautiful presentations that get results.
Playgroundai At Playground, we’re building an image editor that combines AI research and product design to enable people to create graphics like a Pro without being one.
Nexusflow.ai Open source NexusRaven-V2, a 13B LLM outperforming GPT-4 in zero-shot function calling, the capability to turn natural language instructions into executable code to use tools.
Perplexity Copilot
Giskard Eliminate risks of biases, performance issues & security holes in ML models. In <8 lines of code.
Haystack Open-source LLM framework to build production-ready applications
Bing Chat Your everyday AI companion
N-Bref Introducing N-Bref: a neural-based decompiler framework
Hydra A framework for elegantly configuring complex applications
Ml-ferret An End-to-End MLLM that Accept Any-Form Referring and Ground Anything in Response.
GTN A new open source framework for automatic differentiation with graphs
ParlAI ParlAI is a unified platform that streamlines the process of researching, training, and evaluating conversational AI models across multiple tasks at once.
Dynabench DynaBench is a research platform for dynamic data collection and benchmarking.
KILT Benchmarking KILT is a resource for training, evaluating and analyzing NLP models on Knowledge Intensive Language Tasks.
Glow Glow is a machine learning compiler that accelerates the performance of deep learning frameworks on different hardware platforms.
AudioCraft AudioCraft is a single-stop code base for all your generative audio needs: music, sound effects, and compression after training on raw audio signals. We have released controllable and high-quality models for music and audio generation from text inputs.
ELF ELF is an extensive, lightweight, and flexible platform for game research that allows researchers and developers to train and test their algorithms in various game environments from board games to custom real-time strategy games.
PHYRE PHYRE is a benchmark for PHYsical REasoning that contains a set of simple classical mechanics puzzles in a 2D environment.
Imagen 2 DeepMind's most advanced text-to-image technology
SynthID Identifying AI-generated content with SynthID
AlphaFold AlphaFold is accelerating research in nearly every field of biology.
Phenaki A model that can synthesize realistic videos from textual prompt sequences.
AlphaZero and MuZero AlphaZero and MuZero are powerful, general AI systems, that mastered a range of board games and video games — and are now helping us solve real-world problems.
AlphaGo AlphaGo mastered the ancient game of Go, defeated a Go world champion, and inspired a new era of AI systems.
PaLM 2 PaLM 2 is our next generation large language model that builds on Google’s legacy of breakthrough research in machine learning and responsible AI.
PaLM-SayCan a robotics algorithm that combines the understanding of language models with the real-world capabilities of a helper robot.
Universal Speech Model Universal Speech Model (USM) is a family of state-of-the-art speech models with 2B parameters trained on 12 million hours of speech and 28 billion sentences of text, spanning 300+ languages.
WaveNet Introduced in 2016, WaveNet was one of the first AI models to generate natural-sounding speech.
AlphaDev AlphaDev uncovered a faster algorithm for sorting, a method for ordering data. Billions of people use these algorithms everyday without realising it.
AlphaCode As part of DeepMind’s mission to solve intelligence, we created a system called AlphaCode that writes computer programs at a competitive level.
AlphaTensor AlphaTensor, the first artificial intelligence (AI) system for discovering novel, efficient, and provably correct algorithms for fundamental tasks such as matrix multiplication.
AlphaStar AlphaStar is the first AI to reach the top league of a widely popular esport without any game restrictions.
Gemini Gemini is built from the ground up for multimodality — reasoning seamlessly across text, images, video, audio, and code.
Unsloth Fast fine-tuning for LLMs, 2x faster with 60% less memory
Crawl4AI Open-source LLM-friendly web crawler and scraper
ExcaliDraw Virtual whiteboard for hand-drawn diagrams
Foldify Protein folding prediction tool
Adaline.AI AI workflow automation
CopilotKit Open-source toolkit for building AI copilots
AG-UI Protocol Agent-User Interaction Protocol for frontend apps
RAG-Anything All-in-one RAG framework
GenAgents Generative agents research implementation
Climate TRACE AI-powered emissions tracking
Veo 3/4 Google's AI video generation
Hailuo AI Cinematic quality video generation by MiniMax
BasedLabs.ai AI image and video creator
Jupyter Agent 2 AI agent for Jupyter notebooks
prompts.chat Awesome AI prompts library
AGENTS.md Open source agent documentation tool
Microsoft Fabric Toolbox Tools and accelerators for Microsoft Fabric
Copilot Studio Kit Microsoft Copilot Studio accelerator kit
LlamaIndex Build knowledge assistants over enterprise data
vLLM High-throughput LLM serving with Qwen3-Next support
Weavy AI-powered design workflows
CoreML for YOLO CoreML export for YOLO11 models
Qwen Qwen 3-Next open model

⬆ back to top

Multimodal Models
Model Provider Capabilities
GPT-4o OpenAI Text, vision, audio
Claude 3.5 Anthropic Text, vision, documents
Gemini Pro Google Text, vision, audio, video
Llama 3.2 Vision Meta Text, vision (open weights)
Pixtral Mistral Text, vision
Qwen2-VL Alibaba Text, vision (open weights)

⬆ back to top

Music Generators
  • AIVA - AI tool for creating music compositions in various genres.
  • Amper AI - Collaborates with musicians to generate original music datasets.
  • Jukebox by OpenAI - Generates music and singing in various styles based on user input.
  • Soundraw - AI tool for creating royalty-free music.
  • Evoke - AI-powered music library with a diverse collection.

⬆ back to top

Newsletters

⬆ back to top

Observability & Tracing
Tool Description Key Features
LangSmith LangChain's observability platform Tracing, debugging, datasets
Phoenix (Arize) Open-source LLM observability Traces, embeddings, evals
Langfuse Open-source tracing Self-hostable, scores, cost tracking
Helicone LLM observability Logging, caching, analytics
Weights & Biases ML experiment tracking Prompts, artifacts, sweeps
Portkey AI gateway Observability, routing, fallbacks
Braintrust Eval and logging platform Experiments, datasets

⬆ back to top

Open Model Ecosystem
Tool Purpose Key Feature
Hugging Face Hub Model repository 500k+ models available
Ollama Local model runner Simple CLI interface
LM Studio Desktop app GUI for running local models
llama.cpp CPU inference Efficient quantization
vLLM High-throughput serving PagedAttention optimization
Axolotl Fine-tuning Easy configuration-based training
Unsloth Fast fine-tuning 2x faster, 60% less memory

⬆ back to top

OpenAI Models and Tools
  • OpenAI Gym - A toolkit for developing and comparing reinforcement learning algorithms.
  • CLIP by OpenAI - Connects vision and language.
  • OpenAI Baselines - High-quality implementations of reinforcement learning algorithms.
  • Jukebox by OpenAI - A neural network that generates music.
  • OpenAI API - Provides access to various OpenAI models.
  • Whisper by OpenAI - A robust speech recognition system with language models.
  • OpenAI Codex - Powers GitHub Copilot, provides code generation capabilities.
  • OpenAI Quickstart - Guides and resources to quickly start implementing OpenAI models.

⬆ back to top

Other Tools
  • Spinach - AI tool for meeting management.
  • Sembly - AI tool for meeting assistance.
  • Fireflies - AI tool for meeting transcriptions.
  • Krisp - Noise cancellation and voice enhancement for meetings.
  • tl;dv - AI tool for meeting summaries.
  • Otter.ai - Transcription service.
  • Fathom - AI tool for data analysis in meetings.

⬆ back to top

Papers

⬆ back to top

Playbooks & Reference Architectures

Official guidance and blueprints from major AI providers.

Microsoft:

Playbook Focus
Azure AI Landing Zone Enterprise AI architecture
Responsible AI Playbook Ethics and governance
Copilot Studio Governance Low-code agent governance
Azure OpenAI Landing Zone Reference architecture
AI Red Team Playbook Security testing

OpenAI:

Playbook Focus
GPT Best Practices Prompt engineering
Safety Best Practices Safe deployments
Production Best Practices Scaling guidance
Moderation Guide Content filtering

Google:

Playbook Focus
Generative AI on Vertex AI GCP AI architecture
Responsible AI Practices Ethics guidance
SAIF (Secure AI Framework) Security framework
Gemini API Best Practices API usage

AWS:

Playbook Focus
Generative AI on AWS AWS AI architecture
Bedrock Security Bedrock security
Well-Architected ML Lens ML best practices

Community:

Playbook Focus
LangChain RAG Best Practices RAG architecture
Anthropic Prompt Engineering Claude prompting
Hugging Face Production Guide Model deployment

⬆ back to top

Podcasts

⬆ back to top

People to Follow

Researchers, practitioners, and thought leaders shaping the AI landscape.

Research & Academia:

Person Affiliation Focus Links
Andrew Ng DeepLearning.AI, Stanford ML education, AI applications Twitter, LinkedIn
Yann LeCun Meta AI, NYU Deep learning, self-supervised learning Twitter
Fei-Fei Li Stanford HAI Computer vision, human-centered AI Twitter
Demis Hassabis Google DeepMind AGI, AlphaFold Twitter
Ilya Sutskever Safe Superintelligence Inc Alignment, scaling Twitter
Geoffrey Hinton University of Toronto Neural networks, AI safety Website
Yoshua Bengio Mila, University of Montreal Deep learning, AI safety Twitter
Andrej Karpathy Independent Neural networks, education Twitter, YouTube

Industry & Practice:

Person Affiliation Focus Links
Sam Altman OpenAI AI products, strategy Twitter
Dario Amodei Anthropic AI safety, Claude Anthropic
Mustafa Suleyman Microsoft AI AI products, ethics Twitter
Satya Nadella Microsoft Enterprise AI Twitter
Jensen Huang NVIDIA AI compute, hardware NVIDIA
Emad Mostaque Stability AI Open-source AI Twitter

Practitioners & Educators:

Person Focus Links
Chip Huyen MLOps, production ML Twitter, Blog
Simon Willison LLM tools, Datasette Twitter, Blog
Hamel Husain LLM engineering Twitter, Blog
Eugene Yan ML systems, RecSys Twitter, Blog
Lilian Weng OpenAI, ML research Blog
Jay Alammar LLM visualization Blog
Sebastian Raschka ML education Twitter, Blog
Harrison Chase LangChain Twitter
Jerry Liu LlamaIndex Twitter

AI Safety & Ethics:

Person Focus Links
Stuart Russell Value alignment Website
Max Tegmark AI existential risk Twitter
Timnit Gebru AI ethics, bias Twitter
Joy Buolamwini Algorithmic justice Twitter
Rumman Chowdhury Responsible AI Twitter

⬆ back to top

Project and Product Management Tools
  • JIRA by Atlassian - JIRA by Atlassian: A tool for agile project management, especially for software development.
  • Basecamp - Basecamp: A web-based project management tool.
  • ClickUp - ClickUp: All-in-one suite to manage people, projects, and everything in between.
  • Monday.com - Monday.com: A Work OS that powers teams to run projects and workflows with confidence.
  • Smartsheet - Smartsheet: A platform for enterprise achievement.
  • Wrike - Wrike: Versatile project management and collaboration software.
  • Notion - Notion: An all-in-one workspace for notes, tasks, wikis, and databases.
  • Podio by Citrix - Podio by Citrix: Customizable work management solution.

⬆ back to top

Prompting guides

⬆ back to top

Prompting libraries
  • Arthur Shield - A paid product for detecting toxicity, hallucination, prompt injection, etc.
  • Chainlit - A Python library for making chatbot interfaces.
  • Embedchain - A Python library for managing and syncing unstructured data with LLMs.
  • FLAML (A Fast Library for Automated Machine Learning & Tuning) - A Python library for automating selection of models, hyperparameters, and other tunable choices.
  • Guardrails.ai - A Python library for validating outputs and retrying failures. Still in alpha, so expect sharp edges and bugs.
  • Guidance - A handy looking Python library from Microsoft that uses Handlebars templating to interleave generation, prompting, and logical control.
  • Haystack - Open-source LLM orchestration framework to build customizable, production-ready LLM applications in Python.
  • LangChain - A popular Python/JavaScript library for chaining sequences of language model prompts.
  • LiteLLM - A minimal Python library for calling LLM APIs with a consistent format.
  • LlamaIndex - A Python library for augmenting LLM apps with data.
  • LMQL - A programming language for LLM interaction with support for typed prompting, control flow, constraints, and tools.
  • OpenAI Evals - An open-source library for evaluating task performance of language models and prompts.
  • Outlines - A Python library that provides a domain-specific language to simplify prompting and constrain generation.
  • Parea AI - A platform for debugging, testing, and monitoring LLM apps.
  • Portkey - A platform for observability, model management, evals, and security for LLM apps.
  • Promptify - A small Python library for using language models to perform NLP tasks.
  • PromptPerfect - A paid product for testing and improving prompts.
  • Prompttools - Open-source Python tools for testing and evaluating models, vector DBs, and prompts.
  • Scale Spellbook - A paid product for building, comparing, and shipping language model apps.
  • Semantic Kernel - A Python/C#/Java library from Microsoft that supports prompt templating, function chaining, vectorized memory, and intelligent planning.
  • Weights & Biases - A paid product for tracking model training and prompt engineering experiments.
  • YiVal - An open-source GenAI-Ops tool for tuning and evaluating prompts, retrieval configurations, and model parameters using customizable datasets, evaluation methods, and evolution strategies.

⬆ back to top

Quantum Computing Tools

⬆ back to top

RAG & Retrieval
Tool Type Description
Chroma Vector DB Open-source embedding database
Pinecone Vector DB Managed vector search service
Weaviate Vector DB Open-source with GraphQL API
Qdrant Vector DB High-performance vector similarity search
Milvus Vector DB Scalable open-source vector database
FAISS Library Facebook's efficient similarity search
Cohere Rerank API Neural reranking for search results
Unstructured Preprocessing Document parsing and chunking

⬆ back to top

Regulations & Policy

AI governance frameworks and regulations by jurisdiction.

European Union:

Regulation Status Key Points
EU AI Act In force (2024) Risk-based classification, prohibited uses, conformity assessments
GDPR In force Data protection, automated decision-making rights
AI Liability Directive Proposed Fault-based liability for AI systems

United Kingdom:

Regulation Status Key Points
AI Safety Institute Active Pre-deployment testing, safety research
UK AI Regulation (Pro-Innovation) Framework Sector-specific, principles-based
ICO AI Guidance Guidance Data protection in AI

United States:

Regulation Status Key Points
Executive Order on AI (14110) In force (2023) Safety standards, red-teaming, watermarking
NIST AI Risk Management Framework Published Risk management guidance
State AI Laws Various Colorado, California, others

China:

Regulation Status Key Points
Generative AI Measures In force (2023) Content moderation, training data requirements
Algorithm Recommendation Rules In force (2022) Algorithmic transparency
Deep Synthesis Provisions In force (2023) Deepfake labeling

International Standards:

Standard Organization Focus
ISO/IEC 42001 ISO AI management system
ISO/IEC 23894 ISO AI risk management
IEEE 7000 IEEE Ethical system design
OECD AI Principles OECD International guidelines

Tracking Resources:

⬆ back to top

Safety, Alignment & Guardrails
Tool Type Description
Guardrails AI Library Output validation and safety rails for LLM apps
NeMo Guardrails Toolkit NVIDIA's programmable safety rails
LLM Guard Library Input/output scanning for security risks
Rebuff Library Prompt injection detection
Lakera Guard API Real-time threat detection
Garak Tool LLM vulnerability scanner
Arthur Shield Platform Toxicity and hallucination detection

Research Organizations:

⬆ back to top

Tokenization Tools
  • BERT - Pre-trained NLP model by Google, effective in tokenization.
  • Gensim - A Python library for topic modelling and document indexing.
  • Stanford NLP - A suite of natural language analysis tools.
  • TextBlob - Simplified text processing in Python.
  • OpenNLP - Machine learning-based toolkit for processing natural language text.
  • Moses - Moses: A statistical machine translation system.
  • Polyglot - Polyglot: Natural language pipeline that supports multilingual applications.
  • UIMA - UIMA: Framework for analysis and annotation of unstructured content.

⬆ back to top

Video Content & Talks

⬆ back to top

Visualization and Analytics Tools
  • Datawrapper - An easy-to-use tool for creating interactive charts and maps.
  • D3.js - A JavaScript library for producing dynamic, interactive data visualizations in web browsers.
  • Sigma.js - A JavaScript library dedicated to graph drawing, for networks and other relational data.
  • Vega - A visualization grammar, a declarative format for creating, saving, and sharing interactive visualization designs.
  • Highcharts - A JavaScript charting library that makes it easy to add interactive charts to web and mobile projects.

⬆ back to top

Video
  • Fliki - Video creation tool.
  • Lumen5 - AI-powered platform for engaging video content creation.
  • Synthesia - Generates videos from text inputs.
  • DeepBrain AI - Video tool.
  • Runway - Video tool.
  • Pictory - Video tool.
  • Flexclip - Offers templates and tools for editing and creating videos.
  • Elai - Customized AI video creation platform.
  • Veed.io - Generates professional-quality videos with speech-to-subtitle features.

⬆ back to top

Writing and Content Creation
  • ClickUp - A productivity software with AI features for writing and task management.
  • ChatGPT by OpenAI - A conversational AI model known for generating text and engaging in natural conversations.
  • Jasper - Specializes in creating long-form content like blog articles and scripts.
  • GrammarlyGO - AI-powered content creation tool for brainstorming and drafting.
  • Copy.ai - AI-assisted tool for producing a range of creative content.
  • Wordtune - AI writing assistant focusing on editing and rephrasing.
  • Writesonic - Optimizes content for search and has a chatbot for content generation.
  • Rytr - Generates SEO-optimized content in seconds using machine learning.
  • Scribe - AI writing assistant for summarizing articles and aiding academic writing.
  • AlphaCode - Coding assistant for writing code, resolving bugs, and suggesting programming solutions.
  • GitHub Copilot - Collaborative coding tool offering code snippets and context-based guidance.
  • GPT-4 by OpenAI - Advanced AI language model for content creation and data analysis.
  • Bard by Google - Chatbot and content-generation tool using LaMDA.
  • Cohere Generate - Creates personalized email content and interactive conversational agents.
  • Claude by Anthropic - AI assistant for text data processing and engaging in natural conversations.
  • Frase IO - Optimizes high-quality SEO content and creates content briefs.
  • Peppertype.ai - Generates content for blogs, product descriptions, and social media.

⬆ back to top

Connect with Us

APIs and Frameworks

flowchart LR
  API[Generative AI APIs] -->|Integration| FW[Frameworks]
  FW -->|Customization| AI[AI Projects]
Loading

About

A repository dedicated to showcasing and exploring the fascinating world of generative artificial intelligence.

generative-ai-hub.gitbook.io/awesomegenerativeai/

Topics

nlp lists open-source machine-learning ai machine-learning-algorithms chatbot artificial-intelligence cheatsheet generative-adversarial-network openai awesome-list guidelines manuals rag generative-ai generativeai

Resources

Readme

License

MIT license

Contributing

Contributing
Activity

Stars

24 stars

Watchers

2 watching

Forks

5 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •