Ashhadul Islam

Ashhadul Islam

Harnessing AI to bridge visionary innovation with real-world impact.

Advanced Retrieval with LlamaPacks: Elevating RAG in Fewer Lines of Code!

less than 1 minute read

Published:

In this post, I explore five Retrieval-Augmented Generation (RAG) methods open-sourced by LlamaIndex, which claim to simplify the RAG process to just about one line of code. Through a series of experiments, I test these methods and compare their effectiveness in terms of accuracy and efficiency.

The highlights? The Auto Merging Retriever Pack and Small-to-big Retrieval Pack from LlamaIndex emerged as the top performers. If you’re curious about the details and how these methods stack up against each other, this post dives into the specifics.

For this experiment, I utilized OpenAI APIs for the language generation component, and the complete code is available as a Google Colab notebook.

To read the entire article, visit the link.

You May Also Enjoy

Chat with Your Obsidian Notes Using the Falcon Mamba 7B Model

less than 1 minute read

Published:

In the age of information, it’s easy to drown in the sea of notes we’ve meticulously collected over time. Imagine having a chat application that understands your notes and fetches the exact information you need, no matter how vast your repository is. Enter Falcon Mamba 7B and Retrieval-Augmented Generation (RAG) — a perfect blend of speed, precision, and language understanding that turns your note-taking chaos into order.

Balancing Regression Datasets with KNNOR-Reg Oversampling Technique

less than 1 minute read

Published:

Enhancing model performance in machine learning often begins with addressing the quality of your data. One of the most challenging issues is the imbalance in the target variable distribution, which can severely impact the accuracy of regression models.

MemGPT: Assimilating Information from Multiple PDFs

less than 1 minute read

Published:

In this post, I explore the capabilities of MemGPT in handling Retrieval-Augmented Generation (RAG) tasks, particularly focusing on its ability to assimilate information from multiple PDF files. While GPT-4 has its strengths, it often struggles with tasks requiring the consolidation of information from several documents. MemGPT, on the other hand, excels in this area, as demonstrated through a series of comparisons.

Super Quick: Retrieval Augmented Generation Using Ollama

less than 1 minute read

Published:

In this post, I delve into the capabilities of Ollama, a powerful infrastructure that simplifies local execution of open-source models and interactions with PDFs. Ollama acts like a Docker system for Large Language Models (LLMs), allowing easy setup of local LLM servers, fine-tuning, and more.