community[minor], azure-cosmosdb[major]: add new integration for Azure CosmosDB for NoSQL

docs/core_docs/.gitignore

@@ -212,8 +212,12 @@ docs/how_to/assign.md
 docs/how_to/assign.mdx
 docs/how_to/agent_executor.md
 docs/how_to/agent_executor.mdx
+docs/integrations/tools/duckduckgo_search.md
+docs/integrations/tools/duckduckgo_search.mdx
 docs/integrations/toolkits/sql.md
 docs/integrations/toolkits/sql.mdx
+docs/integrations/toolkits/openapi.md
+docs/integrations/toolkits/openapi.mdx
 docs/integrations/text_embedding/togetherai.md
 docs/integrations/text_embedding/togetherai.mdx
 docs/integrations/text_embedding/openai.md

docs/core_docs/docs/integrations/platforms/microsoft.mdx

@@ -100,20 +100,36 @@ See a [usage example](/docs/integrations/vectorstores/azure_aisearch).
 import { AzureAISearchVectorStore } from "@langchain/community/vectorstores/azure_aisearch";
 ```
 
+### Azure Cosmos DB for NoSQL
+
+> [Azure Cosmos DB for NoSQL](https://learn.microsoft.com/azure/cosmos-db/nosql/) provides support for querying items with flexible schemas and native support for JSON. It now offers vector indexing and search. This feature is designed to handle high-dimensional vectors, enabling efficient and accurate vector search at any scale. You can now store vectors directly in the documents alongside your data. Each document in your database can contain not only traditional schema-free data, but also high-dimensional vectors as other properties of the documents.
+
+<IntegrationInstallTooltip></IntegrationInstallTooltip>
+
+```bash npm2yarn
+npm install @langchain/azure-cosmosdb
+```
+
+See a [usage example](/docs/integrations/vectorstores/azure_cosmosdb_nosql).
+
+```typescript
+import { AzureCosmosDBNoSQLVectorStore } from "@langchain/azure-cosmosdb";
+```
+
 ### Azure Cosmos DB for MongoDB vCore
 
-> [Azure Cosmos DB for MongoDB vCore](https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/vcore/) makes it easy to create a database with full native MongoDB support. You can apply your MongoDB experience and continue to use your favorite MongoDB drivers, SDKs, and tools by pointing your application to the API for MongoDB vCore account’s connection string. Use vector search in Azure Cosmos DB for MongoDB vCore to seamlessly integrate your AI-based applications with your data that’s stored in Azure Cosmos DB.
+> [Azure Cosmos DB for MongoDB vCore](https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore/) makes it easy to create a database with full native MongoDB support. You can apply your MongoDB experience and continue to use your favorite MongoDB drivers, SDKs, and tools by pointing your application to the API for MongoDB vCore account’s connection string. Use vector search in Azure Cosmos DB for MongoDB vCore to seamlessly integrate your AI-based applications with your data that’s stored in Azure Cosmos DB.
 
 <IntegrationInstallTooltip></IntegrationInstallTooltip>
 
 ```bash npm2yarn
-npm install @langchain/community mongodb
+npm install @langchain/azure-cosmosdb
 ```
 
-See a [usage example](/docs/integrations/vectorstores/azure_cosmosdb).
+See a [usage example](/docs/integrations/vectorstores/azure_cosmosdb_mongodb).
 
 ```typescript
-import { AzureCosmosDBVectorStore } from "@langchain/community/vectorstores/azure_cosmosdb";
+import { AzureCosmosDBMongoDBVectorStore } from "@langchain/azure-cosmosdb";
 ```
 
 ## Document loaders

docs/core_docs/docs/integrations/vectorstores/azure_cosmosdb.mdx → docs/core_docs/docs/integrations/vectorstores/azure_cosmosdb_mongodb.mdx

@@ -1,29 +1,29 @@
-# Azure Cosmos DB
+# Azure Cosmos DB for MongoDB vCore
 
-> [Azure Cosmos DB for MongoDB vCore](https://learn.microsoft.com/en-us/azure/cosmos-db/mongodb/vcore/) makes it easy to create a database with full native MongoDB support. You can apply your MongoDB experience and continue to use your favorite MongoDB drivers, SDKs, and tools by pointing your application to the API for MongoDB vCore account’s connection string. Use vector search in Azure Cosmos DB for MongoDB vCore to seamlessly integrate your AI-based applications with your data that’s stored in Azure Cosmos DB.
+> [Azure Cosmos DB for MongoDB vCore](https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore/) makes it easy to create a database with full native MongoDB support. You can apply your MongoDB experience and continue to use your favorite MongoDB drivers, SDKs, and tools by pointing your application to the API for MongoDB vCore account’s connection string. Use vector search in Azure Cosmos DB for MongoDB vCore to seamlessly integrate your AI-based applications with your data that’s stored in Azure Cosmos DB.
 
 Azure Cosmos DB for MongoDB vCore provides developers with a fully managed MongoDB-compatible database service for building modern applications with a familiar architecture.
 
 Learn how to leverage the vector search capabilities of Azure Cosmos DB for MongoDB vCore from [this page](https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore/vector-search). If you don't have an Azure account, you can [create a free account](https://azure.microsoft.com/free/) to get started.
 
 ## Setup
 
-You'll first need to install the `mongodb` SDK and the [`@langchain/community`](https://www.npmjs.com/package/@langchain/community) package:
+You'll first need to install the [`@langchain/azure-cosmosdb`](https://www.npmjs.com/package/@langchain/azure-cosmosdb) package:
 
 import IntegrationInstallTooltip from "@mdx_components/integration_install_tooltip.mdx";
 
 <IntegrationInstallTooltip></IntegrationInstallTooltip>
 
 ```bash npm2yarn
-npm install @langchain/community mongodb
+npm install @langchain/azure-cosmosdb
 ```
 
 You'll also need to have an Azure Cosmos DB for MongoDB vCore instance running. You can deploy a free version on Azure Portal without any cost, following [this guide](https://learn.microsoft.com/azure/cosmos-db/mongodb/vcore/quickstart-portal).
 
 Once you have your instance running, make sure you have the connection string and the admin key. You can find them in the Azure Portal, under the "Connection strings" section of your instance. Then you need to set the following environment variables:
 
 import CodeBlock from "@theme/CodeBlock";
-import EnvVars from "@examples/indexes/vector_stores/azure_cosmosdb/.env.example";
+import EnvVars from "@examples/indexes/vector_stores/azure_cosmosdb_mongodb/.env.example";
 
 <CodeBlock language="text">{EnvVars}</CodeBlock>
 
@@ -32,7 +32,7 @@ import EnvVars from "@examples/indexes/vector_stores/azure_cosmosdb/.env.example
 Below is an example that indexes documents from a file in Azure Cosmos DB for MongoDB vCore, runs a vector search query, and finally uses a chain to answer a question in natural language
 based on the retrieved documents.
 
-import Example from "@examples/indexes/vector_stores/azure_cosmosdb/azure_cosmosdb.ts";
+import Example from "@examples/indexes/vector_stores/azure_cosmosdb_mongodb/azure_cosmosdb_mongodb.ts";
 
 <CodeBlock language="typescript">{Example}</CodeBlock>
 

docs/core_docs/docs/integrations/vectorstores/azure_cosmosdb_nosql.mdx

@@ -0,0 +1,54 @@
+# Azure Cosmos DB for NoSQL
+
+> [Azure Cosmos DB for NoSQL](https://learn.microsoft.com/azure/cosmos-db/nosql/) provides support for querying items with flexible schemas and native support for JSON. It now offers vector indexing and search. This feature is designed to handle high-dimensional vectors, enabling efficient and accurate vector search at any scale. You can now store vectors directly in the documents alongside your data. Each document in your database can contain not only traditional schema-free data, but also high-dimensional vectors as other properties of the documents.
+
+Learn how to leverage the vector search capabilities of Azure Cosmos DB for NoSQL from [this page](https://learn.microsoft.com/azure/cosmos-db/nosql/vector-search). If you don't have an Azure account, you can [create a free account](https://azure.microsoft.com/free/) to get started.
+
+## Setup
+
+You'll first need to install the [`@langchain/azure-cosmosdb`](https://www.npmjs.com/package/@langchain/azure-cosmosdb) package:
+
+import IntegrationInstallTooltip from "@mdx_components/integration_install_tooltip.mdx";
+
+<IntegrationInstallTooltip></IntegrationInstallTooltip>
+
+```bash npm2yarn
+npm install @langchain/azure-cosmosdb
+```
+
+You'll also need to have an Azure Cosmos DB for NoSQL instance running. You can deploy a free version on Azure Portal without any cost, following [this guide](https://learn.microsoft.com/azure/cosmos-db/nosql/quickstart-portal).
+
+Once you have your instance running, make sure you have the connection string. You can find them in the Azure Portal, under the "Settings / Keys" section of your instance. Then you need to set the following environment variables:
+
+import CodeBlock from "@theme/CodeBlock";
+import EnvVars from "@examples/indexes/vector_stores/azure_cosmosdb_nosql/.env.example";
+
+<CodeBlock language="text">{EnvVars}</CodeBlock>
+
+### Using Azure Managed Identity
+
+If you're using Azure Managed Identity, you can configure the credentials like this:
+
+import ManagedIdentityExample from "@examples/indexes/vector_stores/azure_cosmosdb_nosql/azure_cosmosdb_nosql-managed_identity.ts";
+
+<CodeBlock language="typescript">{ManagedIdentityExample}</CodeBlock>
+
+:::info
+
+When using Azure Managed Identity and role-based access control, you must ensure that the database and container have been created beforehand. RBAC does not provide permissions to create databases and containers. You can get more information about the permission model in the [Azure Cosmos DB documentation](https://learn.microsoft.com/azure/cosmos-db/how-to-setup-rbac#permission-model).
+
+:::
+
+## Usage example
+
+Below is an example that indexes documents from a file in Azure Cosmos DB for NoSQL, runs a vector search query, and finally uses a chain to answer a question in natural language
+based on the retrieved documents.
+
+import Example from "@examples/indexes/vector_stores/azure_cosmosdb_nosql/azure_cosmosdb_nosql.ts";
+
+<CodeBlock language="typescript">{Example}</CodeBlock>
+
+## Related
+
+- Vector store [conceptual guide](/docs/concepts/#vectorstores)
+- Vector store [how-to guides](/docs/how_to/#vectorstores)

examples/package.json

@@ -35,6 +35,7 @@
     "@google/generative-ai": "^0.7.0",
     "@langchain/anthropic": "workspace:*",
     "@langchain/aws": "workspace:*",
+    "@langchain/azure-cosmosdb": "workspace:*",
     "@langchain/azure-dynamic-sessions": "workspace:^",
     "@langchain/azure-openai": "workspace:*",
     "@langchain/baidu-qianfan": "workspace:*",

examples/src/indexes/vector_stores/azure_cosmosdb_mongodb/.env.example

@@ -0,0 +1 @@
+AZURE_COSMOSDB_MONGODB_CONNECTION_STRING=

examples/src/indexes/vector_stores/azure_cosmosdb/azure_cosmosdb.ts → examples/src/indexes/vector_stores/azure_cosmosdb_mongodb/azure_cosmosdb_mongodb.ts

@@ -1,7 +1,7 @@
 import {
-  AzureCosmosDBVectorStore,
-  AzureCosmosDBSimilarityType,
-} from "@langchain/community/vectorstores/azure_cosmosdb";
+  AzureCosmosDBMongoDBVectorStore,
+  AzureCosmosDBMongoDBSimilarityType,
+} from "@langchain/azure-cosmosdb";
 import { ChatPromptTemplate } from "@langchain/core/prompts";
 import { ChatOpenAI, OpenAIEmbeddings } from "@langchain/openai";
 import { createStuffDocumentsChain } from "langchain/chains/combine_documents";
@@ -18,8 +18,8 @@ const splitter = new RecursiveCharacterTextSplitter({
 });
 const documents = await splitter.splitDocuments(rawDocuments);
 
-// Create Azure Cosmos DB vector store
-const store = await AzureCosmosDBVectorStore.fromDocuments(
+// Create Azure Cosmos DB for MongoDB vCore vector store
+const store = await AzureCosmosDBMongoDBVectorStore.fromDocuments(
   documents,
   new OpenAIEmbeddings(),
   {
@@ -28,7 +28,7 @@ const store = await AzureCosmosDBVectorStore.fromDocuments(
     indexOptions: {
       numLists: 100,
       dimensions: 1536,
-      similarity: AzureCosmosDBSimilarityType.COS,
+      similarity: AzureCosmosDBMongoDBSimilarityType.COS,
     },
   }
 );

examples/src/indexes/vector_stores/azure_cosmosdb_nosql/.env.example

@@ -0,0 +1,5 @@
+# Use connection string to authenticate
+AZURE_COSMOSDB_NOSQL_CONNECTION_STRING=
+
+# Use managed identity to authenticate
+AZURE_COSMOSDB_NOSQL_ENDPOINT=

examples/src/indexes/vector_stores/azure_cosmosdb_nosql/azure_cosmosdb_nosql-managed_identity.ts

@@ -0,0 +1,12 @@
+import { AzureCosmosDBNoSQLVectorStore } from "@langchain/azure-cosmosdb";
+import { OpenAIEmbeddings } from "@langchain/openai";
+
+// Create Azure Cosmos DB vector store
+const store = new AzureCosmosDBNoSQLVectorStore(new OpenAIEmbeddings(), {
+  // Or use environment variable AZURE_COSMOSDB_NOSQL_ENDPOINT
+  endpoint: "https://my-cosmosdb.documents.azure.com:443/",
+
+  // Database and container must already exist
+  databaseName: "my-database",
+  containerName: "my-container",
+});

examples/src/indexes/vector_stores/azure_cosmosdb_nosql/azure_cosmosdb_nosql.ts

@@ -0,0 +1,76 @@
+import { AzureCosmosDBNoSQLVectorStore } from "@langchain/azure-cosmosdb";
+import { ChatPromptTemplate } from "@langchain/core/prompts";
+import { ChatOpenAI, OpenAIEmbeddings } from "@langchain/openai";
+import { createStuffDocumentsChain } from "langchain/chains/combine_documents";
+import { createRetrievalChain } from "langchain/chains/retrieval";
+import { TextLoader } from "langchain/document_loaders/fs/text";
+import { RecursiveCharacterTextSplitter } from "@langchain/textsplitters";
+
+// Load documents from file
+const loader = new TextLoader("./state_of_the_union.txt");
+const rawDocuments = await loader.load();
+const splitter = new RecursiveCharacterTextSplitter({
+  chunkSize: 1000,
+  chunkOverlap: 0,
+});
+const documents = await splitter.splitDocuments(rawDocuments);
+
+// Create Azure Cosmos DB vector store
+const store = await AzureCosmosDBNoSQLVectorStore.fromDocuments(
+  documents,
+  new OpenAIEmbeddings(),
+  {
+    databaseName: "langchain",
+    containerName: "documents",
+  }
+);
+
+// Performs a similarity search
+const resultDocuments = await store.similaritySearch(
+  "What did the president say about Ketanji Brown Jackson?"
+);
+
+console.log("Similarity search results:");
+console.log(resultDocuments[0].pageContent);
+/*
+  Tonight. I call on the Senate to: Pass the Freedom to Vote Act. Pass the John Lewis Voting Rights Act. And while you’re at it, pass the Disclose Act so Americans can know who is funding our elections. 
+
+  Tonight, I’d like to honor someone who has dedicated his life to serve this country: Justice Stephen Breyer—an Army veteran, Constitutional scholar, and retiring Justice of the United States Supreme Court. Justice Breyer, thank you for your service. 
+
+  One of the most serious constitutional responsibilities a President has is nominating someone to serve on the United States Supreme Court. 
+
+  And I did that 4 days ago, when I nominated Circuit Court of Appeals Judge Ketanji Brown Jackson. One of our nation’s top legal minds, who will continue Justice Breyer’s legacy of excellence.
+*/
+
+// Use the store as part of a chain
+const model = new ChatOpenAI({ model: "gpt-3.5-turbo-1106" });
+const questionAnsweringPrompt = ChatPromptTemplate.fromMessages([
+  [
+    "system",
+    "Answer the user's questions based on the below context:\n\n{context}",
+  ],
+  ["human", "{input}"],
+]);
+
+const combineDocsChain = await createStuffDocumentsChain({
+  llm: model,
+  prompt: questionAnsweringPrompt,
+});
+
+const chain = await createRetrievalChain({
+  retriever: store.asRetriever(),
+  combineDocsChain,
+});
+
+const res = await chain.invoke({
+  input: "What is the president's top priority regarding prices?",
+});
+
+console.log("Chain response:");
+console.log(res.answer);
+/*
+  The president's top priority is getting prices under control.
+*/
+
+// Clean up
+await store.delete();

examples/src/indexes/vector_stores/azure_cosmosdb/.env.example → libs/langchain-azure-cosmosdb/.env.example

@@ -1,5 +1,11 @@
+# Azure CosmosDB for NoSQL connection string
+AZURE_COSMOSDB_NOSQL_CONNECTION_STRING=
+
+# Azure CosmosDB for NoSQL endpoint (if you're using managed identity)
+AZURE_COSMOSDB_NOSQL_ENDPOINT=
+
 # Azure CosmosDB for MongoDB vCore connection string
-AZURE_COSMOSDB_CONNECTION_STRING=
+AZURE_COSMOSDB_MONGODB_CONNECTION_STRING=
 
 # If you're using Azure OpenAI API, you'll need to set these variables
 AZURE_OPENAI_API_KEY=

libs/langchain-azure-cosmosdb/.eslintrc.cjs

@@ -0,0 +1,66 @@
+module.exports = {
+  extends: [
+    "airbnb-base",
+    "eslint:recommended",
+    "prettier",
+    "plugin:@typescript-eslint/recommended",
+  ],
+  parserOptions: {
+    ecmaVersion: 12,
+    parser: "@typescript-eslint/parser",
+    project: "./tsconfig.json",
+    sourceType: "module",
+  },
+  plugins: ["@typescript-eslint", "no-instanceof"],
+  ignorePatterns: [
+    ".eslintrc.cjs",
+    "scripts",
+    "node_modules",
+    "dist",
+    "dist-cjs",
+    "*.js",
+    "*.cjs",
+    "*.d.ts",
+  ],
+  rules: {
+    "no-process-env": 2,
+    "no-instanceof/no-instanceof": 2,
+    "@typescript-eslint/explicit-module-boundary-types": 0,
+    "@typescript-eslint/no-empty-function": 0,
+    "@typescript-eslint/no-shadow": 0,
+    "@typescript-eslint/no-empty-interface": 0,
+    "@typescript-eslint/no-use-before-define": ["error", "nofunc"],
+    "@typescript-eslint/no-unused-vars": ["warn", { args: "none" }],
+    "@typescript-eslint/no-floating-promises": "error",
+    "@typescript-eslint/no-misused-promises": "error",
+    camelcase: 0,
+    "class-methods-use-this": 0,
+    "import/extensions": [2, "ignorePackages"],
+    "import/no-extraneous-dependencies": [
+      "error",
+      { devDependencies: ["**/*.test.ts"] },
+    ],
+    "import/no-unresolved": 0,
+    "import/prefer-default-export": 0,
+    "keyword-spacing": "error",
+    "max-classes-per-file": 0,
+    "max-len": 0,
+    "no-await-in-loop": 0,
+    "no-bitwise": 0,
+    "no-console": 0,
+    "no-restricted-syntax": 0,
+    "no-shadow": 0,
+    "no-continue": 0,
+    "no-void": 0,
+    "no-underscore-dangle": 0,
+    "no-use-before-define": 0,
+    "no-useless-constructor": 0,
+    "no-return-await": 0,
+    "consistent-return": 0,
+    "no-else-return": 0,
+    "func-names": 0,
+    "no-lonely-if": 0,
+    "prefer-rest-params": 0,
+    "new-cap": ["error", { properties: false, capIsNew: false }],
+  },
+};

libs/langchain-azure-cosmosdb/.gitignore

@@ -0,0 +1,7 @@
+index.cjs
+index.js
+index.d.ts
+index.d.cts
+node_modules
+dist
+.yarn

libs/langchain-azure-cosmosdb/.prettierrc

@@ -0,0 +1,19 @@
+{
+  "$schema": "https://json.schemastore.org/prettierrc",
+  "printWidth": 80,
+  "tabWidth": 2,
+  "useTabs": false,
+  "semi": true,
+  "singleQuote": false,
+  "quoteProps": "as-needed",
+  "jsxSingleQuote": false,
+  "trailingComma": "es5",
+  "bracketSpacing": true,
+  "arrowParens": "always",
+  "requirePragma": false,
+  "insertPragma": false,
+  "proseWrap": "preserve",
+  "htmlWhitespaceSensitivity": "css",
+  "vueIndentScriptAndStyle": false,
+  "endOfLine": "lf"
+}