Data-Sovereign AI and Automated Workflows: Building Fung.ai
Hey,
I'm Bee.
When your worker starts snooping on your personal mail and sharing your details, you don't stop the work that they do, nor do you keep acting as if nothing happened. You look for another worker, one that you can trust to do the job well without sharing your sensitive data. These maids, butlers, henchmen or whatever title they hold become key to your operations and over time you rely more and more on them.
Sovereignty as an infrastructure problem
In the age of AI, a lot of data is shared as people try to integrate AI (Key word - try) within their day to day work. In minutes, tasks that took hours will be done and dusted. As we try to make sure that work is done faster and better, we add more information to the AIs that we use. For context. For reference. And for experimentation. Where does this information go? Who has access to it? And what do they eventually do with it?
Without being paranoid, these questions are asked when you deal with sensitive data, with secrets, strategies and personal data on a day to day basis. With legislation that exists, your customers even ask you what you do with their data and you have to get consent to do certain things with their data. Blah, Blah, Blah. In other words, you need control over what happens to the data and where it goes. For government, the health industry and many other industries, this means that somehow you limit how AI is used. And in big 2026, saying no AI instead of more AI is shooting yourself in the foot. Firstly, your own team will still use AI whenever they can (The AI craze has swept wider and faster than Bieber fever ever did), and you risk being labeled backwards and anti-progress.
..... so how do we get AI without losing control?
We want to protect data. Data is shared via the internet. And stored on the internet. Then processed on the internet. Then the internet is mainly cloud something - cloud computing, cloud storage, etc. And cloud is someone else's computer (popular programmer joke). Whoever owns the computer or can access the data as it is transported invades our privacy, secrecy or our contract to preserve the clients' confidentiality. The problem was also highlighted by Paul Everitt at PyCon ZA (interestingly, I have also been pointing this out since 2024). AI over the internet exposes data and anyone responsible for the data is at the mercy of consequence. Another thing that also happens is jurisdiction over data issues. If the data is out of Zimbabwe, there is little that Zimbabwean courts can do to protect your data. And for an individual like me, that's scary.
.... breaking down the chain
So two surfaces that expose the data - AI and the internet. For each, we can do something. With the internet, we can host our apps and services locally. Some institutions do. The data, networks and gateways to the internet are something that we control. With providers like Google and AWS, you can even set Virtual Private Networks. However, this is only part of the equation. What use would it be to do all that and still surrender the data willingly because we want to use AI? Which is where the second part comes in, using open-weight models that power different AIs out there. Instead of using Google AIs, you can use their model Gemma - which is built from the same research as Gemini. Pretty cool, right? And that was the direction we were taking with Fung.ai.
....enter Fung.ai
Fungai means think. Something that I was trying to create. An artificial brain that is able to execute tasks without relying on external AI providers. The idea behind it was that:
- It should be hosted on a private network/ server (blackboxed)
- It should execute tasks that let business operate autonomously and efficiently
- It should be easily integrable with any system.
This is one digital worker whom you could put within your system and it would give you AI services without sharing your data. It worked on my PC, with a dynamic Data Analyst persona (skills + tools) that could take any dataset no matter how large, look at it, clean it and then visualise and interpret the data. I even tried it with a 40MB CSV; my machine froze a bit, but it worked.
...ripping apart the brain
With an LLM, we had something that could get text and give related text back as output. A parrot, as others would say. However, looking at recent LLMs, they are past parrot territory. More of monkey see, monkey do. Realising this, I knew that I could give it exhaustive instructions and it would try to produce text that followed suit. It kinda worked.
...... until I realised that for so many ops, I had to create very large prompts and then feed in step by step procedures to be followed. And that was too much, especially if I wanted to create so many automated operations. That is when I looked for a specific kind of model - tool-calling Large Language Models. My street explanation is that these are models that can get a list of instructions (tools or functions) and given some input they would choose the right one(s) for the context. This allowed me to now create a tool for each individual operation I wanted and even chain some and at the end of the day, the model that I chose did great (Thanks Qwen2.5).
With so many tools, I now had to define which role uses which tools and at the end of the day, as someone who wanted to automate so many business functions, I ended up creating skills - which bore instructions on what tools could be used and the tone and context for replies given for different ops. Which created a new thing for me. A persona. The skill(s) + relevant tools. This allowed me to execute a couple of operations autonomously. Given the fact that this was all done on a personal PC and without live data, I am cautious about claiming that this is a groundbreaking revelation.
I still seek opportunities to test this out to see the eventual performance in real life and real time settings. But what I am proud of is the fact that for a proof of concept, it works.
.... so what does it mean?
For me, this closed a concept I have always thought of. Owning the means of transferring data, blackboxing access to it and integrating AI meaningfully. Under demo settings, it works. And as a proof-of-concept I aim to close off the POC and maybe resurrect it in the future for research or improvement as a hobby thingie.
So this kinda wraps up my technical session on my blog and proceeding from this, I will be writing about anything and everything. Can't wait to see you next time.
Sincerely,
Yours truly
Let's connect via the following platforms: LinkedIn, on X as @Rogue0015, or check the Sessionize speaker profile if you want this signal live on your stage. And if you're new here, start with the talks — this blog is their echo.