Skip to content

Desciption update suggestion for ChatGLM2-6B Int4 Env Install Guide #8628

Open
@fiorezhang

Description

@fiorezhang

For people who first time touch this area, please ensure they could seamlessly install the environment exactly follow the install guide. So I have some suggestions in below for reference:

  1. Conda setup. Please create a separate page for recommended conda env setup steps. Ex: Anaconda download path, version request if any, special steps during install, how to launch the command line. Then each models install guide can link to this same conda setup page to help people smoothly build the environment.
  2. Please add a simple reference code to guide people to install bigdl-llm from local source, important to Chinese users. And please ensure that source's library is well synced.
  3. Please state the code relies on the original ChatGLM2-6B model, don't need to download another 'converted model' because the compiling is in runtime. Also please link to some page to guide people to download the original model file.
  4. Please add a snapshot under '2.1 client' for the generate.py runtime. People can learn the example of parameters, and the expected output as well.
    We gathered the feedback from people who first time setup this environment then meet problems, for your reference. Please consider updating the guide for easier setup. Thanks very much!

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions