BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Biomedical Mathematics Group - ECPv6.15.20//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://www.ibs.re.kr/bimag
X-WR-CALDESC:Events for Biomedical Mathematics Group
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:Asia/Seoul
BEGIN:STANDARD
TZOFFSETFROM:+0900
TZOFFSETTO:+0900
TZNAME:KST
DTSTART:20240101T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Asia/Seoul:20250829T140000
DTEND;TZID=Asia/Seoul:20250829T160000
DTSTAMP:20260423T013445
CREATED:20250727T024418Z
LAST-MODIFIED:20250727T024418Z
UID:11348-1756476000-1756483200@www.ibs.re.kr
SUMMARY:Binning as a Pretext Task: Improving Self-Supervised Learning in Tabular Domains - Jinwoo Hyun
DESCRIPTION:In this talk\, we discuss the paper “Binning as a Pretext Task: Improving Self-Supervised Learning in Tabular Domains” by K. Lee. \nAbstract \nThe ability of deep networks to learn superior representations hinges on leveraging the proper inductive biases\, considering the inherent properties of datasets. In tabular domains\, it is critical to effectively handle heterogeneous features (both categorical and numerical) in a unified manner and to grasp irregular functions like piecewise constant functions. To address the challenges in the self-supervised learning framework\, we propose a novel pretext task based on the classical binning method. The idea is straightforward: reconstructing the bin indices (either orders or classes) rather than the original values. This pretext task provides the encoder with an inductive bias to capture the irregular dependencies\, mapping from continuous inputs to discretized bins\, and mitigates the feature heterogeneity by setting all features to have category-type targets. Our empirical investigations ascertain several advantages of binning: compatibility with encoder architecture and additional modifications\, standardizing all features into equal sets\, grouping similar values within a feature\, and providing ordering information. Comprehensive evaluations across diverse tabular datasets corroborate that our method consistently improves tabular representation learning performance for a wide range of downstream tasks. The codes are available in the supplementary material.
URL:https://www.ibs.re.kr/bimag/event/binning-as-a-pretext-task-improving-self-supervised-learning-in-tabular-domains-jinwoo-hyun/
LOCATION:B232 Seminar Room\, IBS\, 55 Expo-ro Yuseong-gu\, Daejeon\, Daejeon\, 34126\, Korea\, Republic of
CATEGORIES:Journal Club
ORGANIZER;CN="Jae Kyoung Kim":MAILTO:jaekkim@kaist.ac.kr
END:VEVENT
END:VCALENDAR