Ashhadul Islam

Ashhadul Islam

Harnessing AI to bridge visionary innovation with real-world impact.

MemGPT: Assimilating Information from Multiple PDFs

less than 1 minute read

Published:

In this post, I explore the capabilities of MemGPT in handling Retrieval-Augmented Generation (RAG) tasks, particularly focusing on its ability to assimilate information from multiple PDF files. While GPT-4 has its strengths, it often struggles with tasks requiring the consolidation of information from several documents. MemGPT, on the other hand, excels in this area, as demonstrated through a series of comparisons.

Imagine dealing with an organizational chart spread across multiple PDF files and needing to identify members of a particular department. MemGPT’s capacity to integrate data from various sources and provide accurate reports makes it a powerful tool for such tasks.

To dive into the setup and see how MemGPT performs, I’ve used GPT-4 and OpenAI libraries as the backend for a fair comparison. While this post focuses on GPT-4, future articles will explore MemGPT’s support for local models and open-source embeddings.

To read the entire article, visit the link.

You May Also Enjoy

Chat with Your Obsidian Notes Using the Falcon Mamba 7B Model

less than 1 minute read

Published:

In the age of information, it’s easy to drown in the sea of notes we’ve meticulously collected over time. Imagine having a chat application that understands your notes and fetches the exact information you need, no matter how vast your repository is. Enter Falcon Mamba 7B and Retrieval-Augmented Generation (RAG) — a perfect blend of speed, precision, and language understanding that turns your note-taking chaos into order.

Balancing Regression Datasets with KNNOR-Reg Oversampling Technique

less than 1 minute read

Published:

Enhancing model performance in machine learning often begins with addressing the quality of your data. One of the most challenging issues is the imbalance in the target variable distribution, which can severely impact the accuracy of regression models.

Advanced Retrieval with LlamaPacks: Elevating RAG in Fewer Lines of Code!

less than 1 minute read

Published:

In this post, I explore five Retrieval-Augmented Generation (RAG) methods open-sourced by LlamaIndex, which claim to simplify the RAG process to just about one line of code. Through a series of experiments, I test these methods and compare their effectiveness in terms of accuracy and efficiency.

Super Quick: Retrieval Augmented Generation Using Ollama

less than 1 minute read

Published:

In this post, I delve into the capabilities of Ollama, a powerful infrastructure that simplifies local execution of open-source models and interactions with PDFs. Ollama acts like a Docker system for Large Language Models (LLMs), allowing easy setup of local LLM servers, fine-tuning, and more.