mlsanityData to 7 Oct 2026

Hierarchical Structure Enhances the Convergence and Generalizability of Linear Molecular Representation

arXiv 2402.02164 ↗First posted 3 Feb 2024cs.AI q-bio.BMcited by 0

Not on the map. Why?

Abstract (arXiv)

Language models demonstrate fundamental abilities in syntax, semantics, and reasoning, though their performance often depends significantly on the inputs they process. This study introduces TSIS (Simplified TSID) and its variants:TSISD (TSIS with Depth-First Search), TSISO (TSIS in Order), and TSISR (TSIS in Random), as integral components of the t-SMILES framework. These additions complete the framework's design, providing diverse approaches to molecular representation. Through comprehensive analysis and experiments employing deep generative models, including GPT, diffusion models, and reinforcement learning, the findings reveal that the hierarchical structure of t-SMILES is more straightforward to parse than initially anticipated. Furthermore, t-SMILES consistently outperforms other linear representations such as SMILES, SELFIES, and SAFE, demonstrating superior convergence speed and enhanced generalization capabilities.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 56 references that are in the map. First posted on arXiv 3 Feb 2024.

Builds on

31 of 56 references.

References · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Scaling Laws for Neural Language Modelscited by 6,411
  3. 2022Generative Adversarial Networkscited by 5,603
  4. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  5. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  6. 2022Emergent Abilities of Large Language Modelscited by 2,483
  7. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  8. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  9. 2018Annotation Artifacts in Natural Language Inference Datacited by 656
  10. 2020Pretrained Transformers Improve Out-of-Distribution Robustnesscited by 293
  11. 2019Deep Learning for Symbolic Mathematicscited by 266
  12. 2017Molecular De Novo Design through Deep Reinforcement Learningcited by 264
19 more
  1. 2019Compositionality decomposed: how do neural networks generalise?cited by 264
  2. 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 212
  3. 2020Drug discovery with explainable artificial intelligencecited by 118
  4. 2021Geometric Deep Learning on Molecular Representationscited by 113
  5. 2020When Do You Need Billions of Words of Pretraining Data?cited by 104
  6. 2021Position Information in Transformers: An Overviewcited by 103
  7. 2023Language Model Behavior: A Comprehensive Surveycited by 92
  8. 2019Learning and Evaluating General Linguistic Intelligencecited by 78
  9. 2022SELFIES and the future of molecular string representationscited by 76
  10. 2021Probing Across Time: What Does RoBERTa Know and When?cited by 73
  11. 2018Rearranging the Familiar: Testing Compositional Generalization in Recurrent Networkscited by 51
  12. 2023Gotta be SAFE: A New Framework for Molecular Designcited by 45
  13. 2018The Importance of Being Recurrent for Modeling Hierarchical Structurecited by 42
  14. 2022Word Order Does Matter (And Shuffled Language Models Know It)cited by 32
  15. 2022Group SELFIES: A Robust Fragment-Based Molecular String Representationcited by 32
  16. 2020Exploring Chemical Space using Natural Language Processing Methodologies for Drug Discoverycited by 24
  17. 2022Intelligent problem-solving as integrated hierarchical reinforcement learningcited by 21
  18. 2023t-SMILES: A Scalable Fragment-based Molecular Representation Framework for De Novo Molecule Generationcited by 13
  19. 2023Difficulty in chirality recognition for Transformer architectures learning chemical structures from stringcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking Molecular Text Representations for LLMs: An Empirical Study
  2. 2024Text-Guided Molecule Generation with Diffusion Language Model
  3. 2026Back to Basics: Improving Molecular Understanding in LLMs via SMILES-Graph Translation
  4. 2024HIGHT: Hierarchical Graph Tokenization for Molecule-Language Alignment
  5. 2025RTMol: Rethinking Molecule-text Alignment in a Round-trip View
  6. 2026Improving Molecular Property Prediction in Small Language Models Using Graph-based Tools
  7. 2024SmileyLlama: Modifying Large Language Models for Directed Chemical Space Exploration
  8. 2025Thinking like a CHEMIST: Combined Heterogeneous Embedding Model Integrating Structure and Tokens