Models
OCI Generative AI provides access to pretrained, foundational models from Cohere and Meta. See our product documentation for the latest available models.
Agent Hub
Agent Hub, a new OCI Generative AI feature, provides a streamlined way to build, deploy, and manage advanced AI-powered agents that can automate business processes, improve decision-making, and accelerate innovation. This new functionality combines state-of-the-art generative AI models, easy integration with both Oracle and third-party systems, and out-of-the-box support for leading open source agent frameworks—all through one standards-based interface.
Interested in beta access to Agent Hub? Learn more here.
Chat API and Playground
The chat experience provides an out-of-the box interface with Cohere and Meta models where users can ask questions and get conversational responses via the OCI console or API.
Dedicated AI clusters
With dedicated AI clusters, you can host foundational models on dedicated GPUs that are private to you. These clusters provide stable, high-throughput performance that’s required for production use cases and can support hosting and fine-tuning workloads. OCI Generative AI enables you to scale out your cluster with zero downtime to handle changes in volume.
Chat API and Playground
The chat experience provides an out-of-the box interface with Cohere and Meta models where users can ask questions and get conversational responses via the OCI console or API.
LangChain integration
OCI Generative AI is integrated with LangChain, an open source framework that can be used to develop new interfaces for generative AI applications based on language models. LangChain makes it easy to swap out abstractions and components that are necessary to work with language models.
LlamaIndex integration
Use LlamaIndex, an open source framework for building context-augmented applications, with OCI Generative AI to easily build RAG solutions or agents. Bring your solutions from prototype to production with custom data sources and flexible tooling.
Generative AI operations
OCI Generative AI provides content moderation controls, and coming soon: endpoint model swap with zero downtime, and endpoints deactivation and activation capabilities. For each model endpoint, OCI Generative AI captures a series of analytics, including call statistics, tokens processed, and error counts.
OCI Generative AI for Oracle Fusion Cloud Applications
By embedding features created with OCI Generative AI directly into Oracle Cloud Applications, we make it easy for customers to instantly access them without complex integrations.