Refactor retrieval and agent functions for improved chunk handling and error management

Refactor agentic_rag function to include memory parameter and enhance prompt clarity with detailed instructions for context usage and search behavior.

Update agentic_rag function to clarify context usage in responses

Refactor PDF processing and embedding creation; update chunking to include metadata

Refactor preprocessing.py to enhance PDF processing and integrate FAISS for similarity search

initial