Have you ever wanted to run your own AI bot for personal use? With the available llama.cpp model developed by Facebook, it is possible to bind using go-llama.cpp.
go-llama.cpp is a binding module written in golang. According to their documentation, the binding are high level - coded in C/C++ for higher response. It is possible to run AI bot using CPU and GPU. But the recommended setup would be to have a dedicated GPU with a CPU with higher frequency machines.
GRE – Generic Routing Encapsulation is a protocol developed by Cisco for encapsulating data packets that use one routing protocol inside the packets of another protocol. GRE wraps the data packet within another data packet. GRE is usually configured at router/ISP/DC level but here we are going to route it between two different vps servers.
Scenario:
VM1 is DDoS protected and will serve all traffic originating from VM2
VM2 will run the applications on selected ports
Umami is a self hosted version of your own Google Analytics. It provides privacy friendly analytics on your website’s visitors. There is no cookie tracking and it provides a pretty dashboard UI. I find it very minimalistic and packed with adequate features for any analytic purpose. It gives a very good overview of Visitor’s count (also live), Pages, Referrers, Browsers, Operating systems, Devices, Countries and a Map.
Installation: # https://umami.is/docs/install – official docs
With webtop – you can run an isolated container with full features of running a distro OS on the web browser.
Warning: Running a web browser over the public internet imposes a great security threat. Please be careful while setting up the instance and make sure you use a strong password.
Webtop uses technology stack of,
Guacamole Server xrdp Server Pulseaudio Custom nodejs frontend Everything works fine except – clipboard (I will update the article when I figure it out)
Nginx proxy manager is an easy tool to help manage your applications running on different ports. It has the added benefit of adding free SSL via letsencrypt. You can manager users, modify permission and check audit logs. Best of all – it is on docker!
Install docker
Create docker-compose.yml and paste the below,
version: '3' services: app: image: 'jc21/nginx-proxy-manager:latest' restart: unless-stopped ports: - '80:80' - '81:81' - '443:443' volumes: - .