Open
Description
For people who first time touch this area, please ensure they could seamlessly install the environment exactly follow the install guide. So I have some suggestions in below for reference:
- Conda setup. Please create a separate page for recommended conda env setup steps. Ex: Anaconda download path, version request if any, special steps during install, how to launch the command line. Then each models install guide can link to this same conda setup page to help people smoothly build the environment.
- Please add a simple reference code to guide people to install bigdl-llm from local source, important to Chinese users. And please ensure that source's library is well synced.
- Please state the code relies on the original ChatGLM2-6B model, don't need to download another 'converted model' because the compiling is in runtime. Also please link to some page to guide people to download the original model file.
- Please add a snapshot under '2.1 client' for the generate.py runtime. People can learn the example of parameters, and the expected output as well.
We gathered the feedback from people who first time setup this environment then meet problems, for your reference. Please consider updating the guide for easier setup. Thanks very much!