machine learning

sepdek December 10, 2025

Suppose a collection contains a small set of confirmed matches and thousands of items nobody has checked. Treating every unchecked item as a non-match gives us a convenient training table—but some of its labels will be invented. This is the starting point of positive–unlabelled learning. We know that certain examples are positive. For the others, […]

sepdek July 17, 2025

Geometry Meets Attention: Understanding SVDA from the Ground Up Based on our newly (2025) published IEEE Access paper: Geometry Meets Attention: Interpretable Transformers via SVD Inspiration Self-attention is the engine behind modern Transformers, but standard dot-product attention is a black box. Why does a model attend to certain tokens? Can we understand what dimensions matter […]

sepdek August 30, 2022

Definition Typically, three Pythagorean means are defined and constitute the classical means used in various scientific fields; they are the arithmetic mean, the geometric mean, and the harmonic mean. Pythagoreans are reported to have first studied these means, along with later generations of Greek mathematicians, and this is why the means got the name ‘Pythagorean’. […]

sepdek February 16, 2018

Clustering is an important category of machine learning methods and a main form of unsupervised learning. Clustering is essentially distinctive and substantially different from the other dominant form of machine learning, classification, in that it does not rely on training (supervised learning). In principle, clustering represents any method that tries to identify and distinguish groups […]

sepdek January 23, 2018

This post serves as a practical approach towards a vectorized implementation of the Expectation Maximization (EM) algorithm mainly for MATLAB or OCTAVE applications. EM is a really powerful and elegant method for finding maximum likelihood solutions in cases where the hypothesis involves a gaussian mixture model and latent variables. Introduction EM is connected with the […]