ERNIE 3.0 & 3.0 Titan

model
Baidu
Baidu's first massive-scale model (260B parameters) combining structured knowledge graphs with unstructured text.
Paper (arXiv)

Model Details

Architecture DENSE
Parameters 260B

Paper

arXiv: 2107.02137

knowledge-graphscaling