A Personal Knowledge Base (KB)
What is a personal kb?
Think of a personal knowledge base is you’re very own wiki. An organised repository that serves as an ‘extended brain’. The idea is to keep complex and connected notes in a single place. The primary benefit of maintaining a personal KB is the way it enhances learning and memory. With a well-organised KB, I can easily access information from past projects or revisit learned concepts, which is invaluable in a field as vast and rapidly evolving as data engineering. Additionally, it serves as a central hub for any intellectual pursuits, enabling cross-pollination of ideas between different areas of expertise.
Core Components of My Personal KB
- Design Patterns: These are templates or blueprints I use to solve recurring problems in data engineering system design. By documenting these patterns, I’m able to quickly apply proven solutions to new challenges.
- Technology-Specific Posts: My KB includes detailed explorations of specific technologies, programming languages, and frameworks. These posts vary from summarises, details of specific solutions to errors as well as deep dives into new products.
- Reflective Thoughts: I also use my personal KB to record reflections on projects, books, and articles.
Tools and Technologies
I use a mix of markdown files, obsidian and various plugins to structure my KB. This setup ensures that related concepts can be linked effortlessly through tags and links, but also reduces the time it takes to publish. A key priority for this project is to ensure that the time it takes to write an article is effectively the time it takes to publish. In other words, there is little time lost to publishing, navigating tools such as WordPress etc.