Search - Code Extractor

function clean_text

Cleans and normalizes text content by removing HTML tags, normalizing whitespace, and stripping markdown formatting elements.

File: /tf/active/vicechatdev/improved_convert_disclosures_to_table.py

text-processing text-cleaning normalization html-removal markdown-removal

function clean_text_for_xml

Sanitizes text by removing or replacing XML-incompatible characters to ensure compatibility with Word document XML structure.

File: /tf/active/vicechatdev/improved_convert_disclosures_to_table.py

text-processing xml sanitization word-documents character-encoding

function extract_warranty_data_improved

Parses markdown-formatted warranty documentation to extract structured warranty data including IDs, titles, sections, disclosure text, and reference citations.

File: /tf/active/vicechatdev/improved_convert_disclosures_to_table.py

markdown-parsing text-extraction warranty-processing document-parsing regex

function create_csv_report_improved

Creates two CSV reports from warranty data: a summary report with key fields and a detailed report with all fields including full disclosures.

File: /tf/active/vicechatdev/improved_convert_disclosures_to_table.py

csv report-generation file-io warranty data-export

function create_excel_report_improved

Creates a multi-sheet Excel report from warranty data, including main report, summary view, complete data, references, and statistics sheets with auto-formatted columns.

File: /tf/active/vicechatdev/improved_convert_disclosures_to_table.py

excel reporting data-export pandas multi-sheet

function parse_references_section

Parses a formatted references section string and extracts structured data including reference numbers, sources, and content previews using regular expressions.

File: /tf/active/vicechatdev/improved_convert_disclosures_to_table.py

parsing text-processing references citations regex

function create_word_report_improved

Generates a formatted Microsoft Word document report containing warranty disclosures with table of contents, structured sections, and references.

File: /tf/active/vicechatdev/improved_convert_disclosures_to_table.py

document-generation word-processing report-generation docx warranty-management

class RegulatoryExtractor

A class for extracting structured metadata from regulatory guideline PDF documents using LLM-based analysis and storing the results in an Excel tracking spreadsheet.

File: /tf/active/vicechatdev/reg_extractor.py

pdf-extraction regulatory-documents llm-extraction ocr data-extraction

function test_complex_url_hyperlink

A test function that validates the creation of Word documents with complex FileCloud URLs containing special characters, query parameters, and URL fragments as clickable hyperlinks.

File: /tf/active/vicechatdev/test_complex_hyperlink.py

testing word-document hyperlink docx url-handling

function extract_warranty_data

Parses markdown-formatted warranty documentation to extract structured warranty information including IDs, titles, sections, source document counts, warranty text, and disclosure content.

File: /tf/active/vicechatdev/convert_disclosures_to_table.py

markdown-parsing data-extraction warranty-processing text-processing regex

function create_csv_report

Creates two CSV reports (summary and detailed) from warranty data, writing warranty information to files with different levels of detail.

File: /tf/active/vicechatdev/convert_disclosures_to_table.py

csv reporting data-export file-io warranty

function create_excel_report

Creates a multi-sheet Excel report from warranty data, including main report, summary view, complete data, and statistics sheets with auto-formatted columns.

File: /tf/active/vicechatdev/convert_disclosures_to_table.py

excel reporting data-export pandas openpyxl

function create_word_report

Generates a formatted Microsoft Word document report containing warranty disclosures with a table of contents, metadata, and structured sections for each warranty.

File: /tf/active/vicechatdev/convert_disclosures_to_table.py

document-generation word-document docx report-generation warranty

function main_v15

Converts a markdown file containing warranty disclosure data into multiple tabular formats (CSV, Excel, Word) with timestamped output files.

File: /tf/active/vicechatdev/convert_disclosures_to_table.py

markdown-conversion data-extraction report-generation csv-export excel-export

function create_enhanced_word_document

Converts markdown-formatted warranty disclosure content into a formatted Microsoft Word document with hierarchical headings, styled text, lists, and special formatting for block references.

File: /tf/active/vicechatdev/improved_word_converter.py

document-generation markdown-to-word docx warranty-processing legal-documents

function clean_text_for_xml_v1

Sanitizes text strings to ensure XML 1.0 compatibility by removing or replacing invalid control characters and ensuring all characters meet XML specification requirements for Word document generation.

File: /tf/active/vicechatdev/enhanced_word_converter_fixed.py

text-processing xml sanitization data-cleaning word-documents

function extract_warranty_sections

Parses markdown content to extract warranty section headers, returning a list of dictionaries containing section IDs and titles for table of contents generation.

File: /tf/active/vicechatdev/enhanced_word_converter_fixed.py

markdown-parsing text-processing warranty-documents table-of-contents document-structure

function extract_total_references

Extracts the total count of references from markdown-formatted content by first checking for a header line with the total, then falling back to manually counting reference entries.

File: /tf/active/vicechatdev/enhanced_word_converter_fixed.py

markdown parsing text-processing references bibliography

function create_enhanced_word_document_v1

Converts markdown content into a formatted Microsoft Word document with proper styling, table of contents, warranty sections, and reference handling for Project Victoria warranty disclosures.

File: /tf/active/vicechatdev/enhanced_word_converter_fixed.py

document-generation word-processing markdown-conversion docx formatting

function format_inline_references

Formats inline citation references (e.g., [1], [2]) in a Word document paragraph by applying italic styling to them while preserving the rest of the text.

File: /tf/active/vicechatdev/enhanced_word_converter_fixed.py

document-formatting word-processing python-docx text-formatting citations

class MyEmbeddingFunction_v1

A custom embedding function class that generates embeddings for documents using OpenAI's API, with built-in text summarization for long documents and token management.

File: /tf/active/vicechatdev/OneCo_hybrid_RAG copy.py

embeddings openai chromadb vector-database text-summarization

class SimpleDataHandle

A data handler class that manages multiple data sources with different types (dataframes, vector stores, databases) and their associated processing configurations.

File: /tf/active/vicechatdev/OneCo_hybrid_RAG copy.py

data-management registry vector-store RAG dataframe

class OneCo_hybrid_RAG

A class named OneCo_hybrid_RAG

File: /tf/active/vicechatdev/OneCo_hybrid_RAG copy.py

class oneco_hybrid_rag

class ReferenceManager

Manages document references for inline citation and bibliography generation in a RAG (Retrieval-Augmented Generation) system.

File: /tf/active/vicechatdev/fixed_project_victoria_generator.py

citation bibliography reference-management document-tracking RAG

class FixedProjectVictoriaGenerator

Fixed Project Victoria Disclosure Generator that properly handles all warranty sections.

File: /tf/active/vicechatdev/fixed_project_victoria_generator.py

class fixedprojectvictoriagenerator

function main_v55

Entry point function that instantiates a FixedProjectVictoriaGenerator and executes its complete pipeline to generate fixed disclosure documents.

File: /tf/active/vicechatdev/fixed_project_victoria_generator.py

entry-point pipeline disclosure-generation orchestration main-function

function create_document

Creates a new controlled document in a document management system with versioning, audit trails, and optional initial content.