Geotokens and Geotransformers
Clicks: 31
ID: 283372
2024
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This
article has not been analysed, so there is no overall score —
reader engagement is measured and shown alongside.
Reader Engagement
Emerging Content
9.0
/100
31 views
17 readers
AI Quality Assessment
Not analyzed
Readership in this journal
EmergingRanked #709 of 803 articles by views in arXiv
Most read
Least read
Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 803 in total.
Mint this article as an NFT
Not yet mintedCreate a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.
5
SUSD
one-off · no wallet required
Abstract
In transformer architectures, position encoding primarily provides a sense of
sequence for input tokens. While the original transformer paper's method has
shown satisfactory results in general language processing tasks, there have
been new proposals, such as Rotary Position Embedding (RoPE), for further
improvement. This paper presents geotokens, input components for transformers,
each linked to a specific geological location. Unlike typical language
sequences, for these tokens, the order is not as vital as the geographical
coordinates themselves. To represent the relative position in this context and
to keep a balance between the real world distance and the distance in the
embedding space, we design a position encoding approach drawing from the RoPE
structure but tailored for spherical coordinates.
| Reference Key |
unlu2024geotokens
Use this key to autocite in the manuscript while using
SciMatic Manuscript Manager or Thesis Manager
|
|---|---|
| Authors | Eren Unlu |
| Journal | arXiv |
| Year | 2024 |
| DOI |
DOI not found
|
| URL | |
| Keywords |
Citations
No citations found. To add a citation, contact the admin at info@scimatic.org
Comments
No comments yet. Be the first to comment on this article.