Dev (#1689)

* Fix an issue where CMD+K does not clear the terminal when the terminal has focus (#1671)

On MacOS, ⌘+K is bound, by default, to Terminal:Clear. Without this
change ⌘+K does not clear the terminal but instead iniates a chord
sequence and waits for the next stroke of the chord.

Co-authored-by: Rob Leidle <[email protected]>

* Change treeSitter to cache the Language objects it loads from wasm (#1672)

Without this change, for a repository with 600 typescript files, the
indexer would fail to finish correctly and there would be many of the
following errors in the webview console log:

'Unable to load language for file ${path} RuntimeError: table index is out of bounds'

The following bash will create a repo that reproduces the problem:

current_path="."

for ((i=1; i<=20; i++)); do
    new_folder="folder-$i"
    mkdir -p "$current_path/$new_folder"
    current_path="$current_path/$new_folder"

    for ((a=1; a<=30; a++)); do
      head -c 10000 /dev/urandom | base64 > "$current_path/file-$a.ts"
    done
done

Co-authored-by: Rob Leidle <[email protected]>

* acknowledge sourcemap flag in esbuild.js

* don't run jetbrains-release.yaml on vscode releases

* further testing for walkDir

* chore: add telemetry to commands (#1673)

* test: Add basic unit test to baseLLM (#1668)

* update version

* test: Add basic unit test to baseLLM

---------

Co-authored-by: Nate Sesti <[email protected]>
Co-authored-by: inimaz <[email protected]>

* feat: add Quick Actions CodeLens feature (#1674)

* docs: add docs and schema for "OS" provider (#1536)

* ignore .env

* ✨ use and cache imports for autocomplete (#1456)

* ✨ use and cache imports for autocomplete

* fix tsc

* add voyage rerank-1

* import Handlebars

* feat: open pane on install (#1564)

* feat: open pane on activation

* comment out testing code

* chore: add telemetry for pageviews (#1576)

* feat: update onboarding w/ embeddings model (#1570)

* chore(gui): remove unused pages

* feat: add embeddings step

* feat: update styles

* feat: copy button updates

* fix: correct pull command for embed model

* fix: remove commented code

* fix: remove commented code

* feat: simplify copy btn props

* chore: rename onboarding selection event

* feat: add provider config

* fix: undo msg name

* remove dead code

* fix: invalid mode check

* fix: remove testing logic

* fix: fullscreen gui retains context when hidden, fixed fullscreen focusing (#1582)

* small UI tweaks

* media query

* feat: add best experience onboarding

* small fixes

* feat: add free trial card to onboarding (#1600)

* feat: add free trial card to onboarding

* add import

* chore: add telemetry for full screen toggle (#1618)

* rerank-lite-1

* remove doccs

* basic tests for VS Code extension

* improved testing of VS Code extension

* manually implement stop tokens for hf inference api

* chore: onboarding metrics (#1626)

* fix: pageview tracking

* feat: add onboarding telemetry

* create single `onboardingStatus` type

* improved var naming

* remove console logs

* fix windows performance issue

* rename vscodeExtension.ts

* migration of onboarding variables

* "stash" instead of "delete" in indexing progress

* fix preview.yaml

* also fix main.yaml

* Update troubleshooting.md (#1637)

* feat: add quick actions

* Update index.d.ts

* quick actions mvp

* update docs

* subscribe to vscode change settings

* Update commands.ts

* cleanup

* Update quick-actions.md

* Update VerticalPerLineCodeLensProvider.ts

* resolve feedback

---------

Co-authored-by: Nate Sesti <[email protected]>
Co-authored-by: Nate Sesti <[email protected]>
Co-authored-by: Jonah Wagner <[email protected]>

* chore: add `isCommandEvent` to command telemetry (#1675)

* chore: add `isCommandEvent` to command telemetry

* Update commands.ts

* Nate/better retrieval (#1677)

* deduplicatearray tests

* break out separate retrieval pipelines

* IConfigHandler

* tests for codebase indexer

* better .continueignore for continue

* indexing fixes

* ignore .gitignore and .continueignore when indexing

* retrieval pipeline improvements

* fix formatting err in out .continueignore

* add necessary filter to lance_db_cache

* update package.json version

* skip unused tests

* don't ignore .prompt files

* update version

* Update pull_request_template.md

* don't use multi-media format when there are multiple text items

* add free trial experience (#1685)

* fix: add code range for quick actions/fixes (#1687)

* fix: add code range for quick actions/fixes

* Update test.js

* add pathSep message type

* docs improvements

* jetbrains fix

* update package.json version

---------

Co-authored-by: Rob Leidle <[email protected]>
Co-authored-by: Rob Leidle <[email protected]>
Co-authored-by: Patrick Erichsen <[email protected]>
Co-authored-by: inimaz <[email protected]>
Co-authored-by: inimaz <[email protected]>
Co-authored-by: Jonah Wagner <[email protected]>
Co-authored-by: Priyash <[email protected]>

Author: 8 people

.github/pull_request_template.md

@@ -9,4 +9,8 @@
 
 ## Screenshots
 
-If your updates include visual changes, please share screenshots below.
+[ "For visual changes, include screenshots." ]
+
+## Testing
+
+[ For new or modified features, provide testing instructions. ]

binary/src/IpcMessenger.ts

@@ -170,8 +170,8 @@ export class IpcMessenger<
     });
   }
   _sendMsg(msg: Message) {
-    // console.log("[info] Sending message: ", msg);
     const d = JSON.stringify(msg);
+    // console.log("[info] Sending message: ", d);
     process.stdout?.write(d + "\r\n");
   }
 }

core/llm/llms/OpenAI.ts

@@ -57,16 +57,13 @@ class OpenAI extends BaseLLM {
   protected _convertMessage(message: ChatMessage) {
     if (typeof message.content === "string") {
       return message;
-    } else if (
+    } else if (!message.content.some((item) => item.type !== "text")) {
       // If no multi-media is in the message, just send as text
       // for compatibility with OpenAI "compatible" servers
       // that don't support multi-media format
-      message.content.length === 1 &&
-      message.content[0].type === "text"
-    ) {
       return {
         ...message,
-        content: message.content[0].text,
+        content: message.content.map((item) => item.text).join(""),
       };
     }
 

core/protocol/ideWebview.ts

@@ -41,7 +41,14 @@ export type ToWebviewFromIdeProtocol = ToWebviewFromIdeOrCoreProtocol & {
   focusContinueInput: [undefined, void];
   focusContinueInputWithoutClear: [undefined, void];
   focusContinueInputWithNewSession: [undefined, void];
-  highlightedCode: [{ rangeInFileWithContents: RangeInFileWithContents }, void];
+  highlightedCode: [
+    {
+      rangeInFileWithContents: RangeInFileWithContents;
+      prompt?: string;
+      shouldRun?: boolean;
+    },
+    void,
+  ];
   addModel: [undefined, void];
   openSettings: [undefined, void];
   viewHistory: [undefined, void];

docs/docs/setup/configuration.md

@@ -8,19 +8,51 @@ keywords: [configure, llm, provider]
 
 Want a quick and easy setup for Continue? We've got you covered with some sample `config.json` files for different scenarios. Just copy and paste them into your `config.json` by clicking the gear icon at the bottom right of the Continue sidebar.
 
-## Best Overall Experience
+## Quick Setup Options
+
+You can use Continue in different ways. Here are some quick setups for common uses:
+
+- [Free Trial](#free-trial) - Try Continue without any additional setup.
+- [Best Overall Experience](#best-overall-experience) - Utilize the hand picked models for the best experience.
+- [Local and Offline](#local-and-offline-configuration) - Use local models for offline use with better privacy.
+
+### Free Trial
+
+The `free-trial` lets new users try out Continue with GPT-4o, Llama3, Claude 3.5, and other models using a ContinueDev proxy server that securely makes API calls to these services.
+
+```json title="~/.continue/config.json"
+{
+  "models": [
+    {
+      "title": "GPT-4o (trial)",
+      "provider": "free-trial",
+      "model": "gpt-4o"
+    }
+  ],
+  "tabAutocompleteModel": {
+    "title": "Codestral (trial)",
+    "provider": "free-trial",
+    "model": "AUTODETECT"
+  },
+  "embeddingsProvider": {
+    "provider": "free-trial"
+  },
+  "reranker": {
+    "name": "free-trial"
+  }
+}
+```
+
+### Best Overall Experience
 
 This setup uses Claude 3.5 Sonnet for chatting, Codestral for autocomplete, and Voyage AI for embeddings and reranking.
 
 **What You Need:**
 
-1. Get a Codestral API key from [Mistral AI's La Plateforme](https://console.mistral.ai/codestral)
-2. Get an Anthropic API key from [Anthropic Console](https://console.anthropic.com/account/keys)
-3. Replace `[CODESTRAL_API_KEY]` and `[ANTHROPIC_API_KEY]` with the keys you got from the above links.
-
-:::note
-This example uses a free trial for embeddings and reranking, forwarding requests via ContinueDev proxy. For direct service, get a Voyage AI API key and update the `provider` and `apiKey` fields. See the [config reference for Voyage AI](../walkthroughs//codebase-embeddings.md#voyage-ai) for details on how to set this up.
-:::
+1. Get an Anthropic API key from [Anthropic Console](https://console.anthropic.com/account/keys)
+2. Get a Codestral API key from [Mistral AI's La Plateforme](https://console.mistral.ai/codestral)
+3. Get an Voyage AI API key from [Voyage AI Dashboard](https://dash.voyageai.com/)
+4. Replace `[CODESTRAL_API_KEY]`, `[ANTHROPIC_API_KEY]`, and `[VOYAGE_API_KEY]` with the keys you got from the above links.
 
 ```json title="~/.continue/config.json"
 {
@@ -39,15 +71,21 @@ This example uses a free trial for embeddings and reranking, forwarding requests
     "apiKey": "[CODESTRAL_API_KEY]"
   },
   "embeddingsProvider": {
-    "provider": "free-trial"
+    "provider": "openai",
+    "model": "voyage-code-2",
+    "apiBase": "https://api.voyageai.com/v1/",
+    "apiKey": "[VOYAGE_AI_API_KEY]"
   },
   "reranker": {
-    "name": "free-trial"
+    "name": "voyage",
+    "params": {
+      "apiKey": "[VOYAGE_AI_API_KEY]"
+    }
   }
 }
 ```
 
-## Local and Offline Configuration
+### Local and Offline Configuration
 
 This configuration leverages Ollama for all functionalities - chat, autocomplete, and embeddings - ensuring that no code is transmitted outside your machine, allowing Continue to be run even on an air-gapped computer.
 
@@ -135,39 +173,57 @@ If you need to send custom headers for authentication, you may use the `requestO
 
 ```json title="~/.continue/config.json"
 {
-   "models": [
-      {
-         "title": "Ollama",
-         "provider": "ollama",
-         "model": "llama2-7b",
-         "requestOptions": {
-            "headers": {
-               "X-Auth-Token": "xxx"
-            }
-         }
+  "models": [
+    {
+      "title": "Ollama",
+      "provider": "ollama",
+      "model": "llama2-7b",
+      "requestOptions": {
+        "headers": {
+          "X-Auth-Token": "xxx"
+        }
       }
-   ]
+    }
+  ]
 }
 ```
 
 Similarly if your model requires a Certificate for authentication, you may use the `requestOptions.clientCertificate` property like in the example below:
 
 ```json title="~/.continue/config.json"
 {
-   "models": [
-      {
-         "title": "Ollama",
-         "provider": "ollama",
-         "model": "llama2-7b",
-         "requestOptions": {
-            "clientCertificate": {
-               "cert": "C:\temp\ollama.pem",
-               "key": "C:\temp\ollama.key",
-               "passphrase": "c0nt!nu3"
-            }
-         }
+  "models": [
+    {
+      "title": "Ollama",
+      "provider": "ollama",
+      "model": "llama2-7b",
+      "requestOptions": {
+        "clientCertificate": {
+          "cert": "C:\tempollama.pem",
+          "key": "C:\tempollama.key",
+          "passphrase": "c0nt!nu3"
+        }
       }
-   ]
+    }
+  ]
+}
+```
+
+## Context Length
+
+Continue by default knows the context length for common models. For example, it will automatically assume 200k tokens for Claude 3. For Ollama, the context length is determined automatically by asking Ollama. If neither of these are sufficient, you can manually specify the context length by using hte `"contextLength"` property in your model in config.json.
+
+```json title="~/.continue/config.json"
+{
+  "models": [
+    {
+      "title": "My Custom Model",
+      "provider": "openai",
+      "model": "my-model",
+      "contextLength": 8192,
+      "apiBase": "http://localhost:8000/v1"
+    }
+  ]
 }
 ```
 

docs/docs/walkthroughs/codebase-embeddings.md

@@ -294,7 +294,7 @@ Continue offers a free trial of Voyage AI's reranking model.
 }
 ```
 
-## Customizing which files are indexed
+## Ignore files during indexing
 
 Continue respects `.gitignore` files in order to determine which files should not be indexed. If you'd like to exclude additional files, you can add them to a `.continueignore` file, which follows the exact same rules as `.gitignore`.
 

extensions/intellij/src/main/kotlin/com/github/continuedev/continueintellijextension/actions/ContinuePluginActions.kt

@@ -172,22 +172,7 @@ class ViewLogsAction : AnAction() {
     }
 }
 
-class ToggleAuxiliaryBarAction : AnAction() {
-    override fun actionPerformed(e: AnActionEvent) {
-        val project = e.project ?: return
-        val toolWindowManager = ToolWindowManager.getInstance(project)
-        val toolWindow = toolWindowManager.getToolWindow("Continue")
-
-        if (toolWindow != null) {
-            if (toolWindow.isVisible) {
-                toolWindow.component.transferFocus()
-                toolWindow.hide(null)
-            } else {
-                toolWindow.activate(null)
-            }
-        }
-    }
-}
+
 
 class FocusContinueInputWithoutClearAction : AnAction() {
     override fun actionPerformed(e: AnActionEvent) {

extensions/intellij/src/main/kotlin/com/github/continuedev/continueintellijextension/continue/CoreMessenger.kt

@@ -147,6 +147,7 @@ class CoreMessenger(private val project: Project, esbuildPath: String, continueC
         "applyToFile",
         "getGitHubAuthToken",
         "setGitHubAuthToken",
+        "pathSep"
     )
 
     private val PASS_THROUGH_TO_WEBVIEW = listOf<String>(

extensions/intellij/src/main/kotlin/com/github/continuedev/continueintellijextension/continue/IdeProtocolClient.kt

@@ -628,6 +628,9 @@ class IdeProtocolClient (
                         java.awt.Desktop.getDesktop().browse(java.net.URI(url))
                         respond(null)
                     }
+                    "pathSep" -> {
+                        respond(File.separator)
+                    }
                     else -> {
                         println("Unknown messageType: $messageType")
                     }

extensions/intellij/src/main/resources/META-INF/plugin.xml

@@ -89,12 +89,7 @@
                 description="View Continue Server Logs">
             <!-- No shortcut defined -->
         </action>
-        <action id="continue.toggleAuxiliaryBar"
-                class="com.github.continuedev.continueintellijextension.actions.ToggleAuxiliaryBarAction"
-                text="Toggle Right Sidebar" description="Toggle Right Sidebar">
-            <keyboard-shortcut keymap="$default" first-keystroke="alt ctrl J"/>
-            <keyboard-shortcut keymap="Mac OS X" first-keystroke="alt meta J"/>
-        </action>
+       
         <action id="continue.focusContinueInputWithoutClear"
                 class="com.github.continuedev.continueintellijextension.actions.FocusContinueInputWithoutClearAction"
                 text="Add selected code to context"

extensions/vscode/package-lock.json

@@ -1,7 +1,7 @@
 {
   "name": "continue",
   "icon": "media/icon.png",
-  "version": "0.9.177",
+  "version": "0.9.178",
   "repository": {
     "type": "git",
     "url": "https://github.com/continuedev/continue"
@@ -143,12 +143,6 @@
         "title": "Generate Code",
         "group": "Continue"
       },
-      {
-        "command": "continue.toggleAuxiliaryBar",
-        "category": "Continue",
-        "title": "Toggle Right Sidebar",
-        "group": "Continue"
-      },
       {
         "command": "continue.focusContinueInput",
         "category": "Continue",
@@ -303,11 +297,6 @@
         "mac": "cmd+i",
         "key": "ctrl+i"
       },
-      {
-        "command": "continue.toggleAuxiliaryBar",
-        "mac": "alt+cmd+l",
-        "key": "alt+ctrl+l"
-      },
       {
         "command": "continue.debugTerminal",
         "mac": "cmd+shift+r",
@@ -337,9 +326,6 @@
         {
           "command": "continue.quickEdit"
         },
-        {
-          "command": "continue.toggleAuxiliaryBar"
-        },
         {
           "command": "continue.focusContinueInput"
         },