Local Chat

You can interact with the InternLM3-8B-Instruct model through a frontend interface by running the following code:

pip install streamlit
pip install transformers>=4.48
streamlit run web_demo.py

It supports switching between different inference modes and comparing their responses.