def extract_from_text(self, text: str, file_path: str = None): entry = "_source": file_path for field, pattern in self.schema.items(): match = re.search(pattern, text, re.IGNORECASE | re.MULTILINE) entry[field] = match.group(1) if match else None self.results.append(entry) return entry
find data/raw -name "*.log" | entr -r python extractor/run_extractor.py Then ask Cursor AI: “Show me the diff of extracted errors between the last two runs.” Cursor Extractor can output to: Cursor Extractor
@workspace Scan all .log files in /logs directory. Extract: error_code, timestamp, endpoint, status_code. Output: single JSON file with each entry keyed by filename. Ignore lines without errors. Save to /extractor/output/errors.json Cursor will generate a script or directly extract depending on your settings. File: extractor/run_extractor.py Ignore lines without errors
extractor = CursorExtractor(schema) for log_file in Path("data/raw/logs").glob("*.log"): content = log_file.read_text() extractor.extract_from_text(content, str(log_file)) From there, build your own extractor library
That’s your first extraction. From there, build your own extractor library.
def __init__(self, schema: Dict[str, str]): self.schema = schema # field -> regex pattern self.results = []