We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: ChemScraper: Graphics Extraction, Molecular Diagram Parsing, and Annotated Data Generation for PDF Images

Abstract: Existing visual parsers for molecule diagrams translate pixel-based raster images such as PNGs to chemical structure representations (e.g., SMILES). However, PDFs created by word processors including \LaTeX{} and Word provide explicit locations and shapes for characters, lines, and polygons. We %introduce a method to extract symbols from born-digital PDF molecule images and then apply simple graph transformations to capture both visual and chemical structure in editable ChemDraw files (CDXML). Our fast ( PDF $\rightarrow$ visual graph $\rightarrow$ chemical graph ) pipeline does not require GPUs, Optical Character Recognition (OCR) or vectorization. We evaluate on standard benchmarks using SMILES strings, along with a novel evaluation that provides graph-based metrics and error compilation using LgEval. The geometric information in born-digital PDFs produces a highly accurate parser, motivating generating training data for visual parsers that recognize from raster images, with extracted graphics, visual structure, and chemical structure as annotations. To do this we render SMILES strings in Indigo, parse molecule structure, and then validate recognized structure to select correct files.
Comments: 20 pages without references, 10 figures, 3 Tables, submitted to International Journal on Document Analysis and Recognition (IJDAR)
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2311.12161 [cs.CV]
  (or arXiv:2311.12161v1 [cs.CV] for this version)

Submission history

From: Ayush Kumar Shah [view email]
[v1] Mon, 20 Nov 2023 20:27:42 GMT (4947kb,D)
[v2] Wed, 22 Nov 2023 03:23:17 GMT (4947kb,D)
[v3] Fri, 26 Apr 2024 16:43:14 GMT (3734kb,D)
[v4] Fri, 31 May 2024 19:53:06 GMT (3703kb,D)

Link back to: arXiv, form interface, contact.