Researchers propose a self-distillation fix for ‘catastrophic forgetting’ in LLMs

LLMs tend to lose prior skills when fine-tuned for new tasks. A new self-distillation approach aims to reduce regression and ...
IEEE

Self-Supervised Learning-Based Multiparameters Optimization Framework in Servo Systems

Abstract: Servo control systems exhibit strong coupling among multiple control parameters, posing dual challenges of efficiency and stability during optimization. Traditional parameter tuning ...
IEEE

Robust Self-Supervised Monocular Depth Estimation for Endoscopic Soft Tissue Deformation Scenes with Biomechanical Constraints

Abstract: Self-supervised learning technology has been applied to calculate depth and ego-motion from monocular videos, achieving remarkable performance in various real-world scenarios. Unfortunately, ...