Summary
在 hyperbolic space 中引入 contrastive learning framework,利用 hierarchical positive sampling 提升 graph representation learning。Node classification 和 graph property prediction 上达到 SOTA。
Problem & Motivation
Graph contrastive learning 问题:
- Euclidean contrastive learning 忽略 graph hierarchy
- Hierarchical data(知识图谱、社交网络)需要 geometry-aware sampling
- Positive/negative sample 定义需要 respect geometry
Method
核心设计:
- Hierarchical Positive Sampling: 在 hyperbolic space 中按 hierarchy 采样 positives
- Geometry-aware Contrastive Loss: 考虑 hyperbolic distance 的 loss design
- Curvature-aware Training: Hyperbolic space 的 gradient handling
理论基础:
- Hyperbolic distance ≈ hierarchy distance
- Contrastive loss in curved space
Key Results
- Node classification SOTA
- Graph property prediction improved
- Few-shot learning scenarios
Strengths & Weaknesses
亮点:
- Hierarchical sampling 是关键创新
- Contrastive learning × hyperbolic geometry 的首次系统结合
局限:
- 具体 benchmark 数字需看全文
- 与 Euclidean contrastive learning 的效率对比
Mind Map
mindmap root((Hyperbolic Contrastive)) Problem Euclidean contrastive limits Hierarchy ignored Method Hierarchical positives Geometry-aware loss Curvature-aware gradient Results Node classification SOTA Graph prediction improved
Notes
[基于 WebSearch 结果创建]
Contrastive learning 与 hyperbolic geometry 的结合是重要方向。Hierarchical positive sampling 的设计思路值得研究。