GitHub - moyix/fauxpilot: FauxPilot - an open-source GitHub Copilot server

This is an attempt to build a locally hosted version of GitHub Copilot. Note that the VRAM requirements listed by setup.sh So, if you have two NVIDIA RTX 3080 GPUs, you should be able to run the 6B model by putting half on each GPU. Run the setup script to choose a model to use. This will download the model from Huggingface and then convert it for use with FasterTransformer.