I am a 3rd year PhD student @ Jagiellonian University supervised by prof. Jacek Tabor and co-advised by prof. Amos Storkey (University of Edinburgh). I spent two summers as a visiting student with prof. Yoshua Bengio. Prior to that I completed industrial internships with Palantir and Microsoft.

My email is staszek.jastrzebski (on gmail).

Research interests:

  • Deep Representation Learning
  • Optimization in Deep Learning
  • Natural Language Processing
  • Computer Aided Drug Design

Co-supervised MSc/BSc students:

  • [MSc] Mikołaj Sacha - Meta learning and sharpness of the minima
  • [MSc] Andrii Krutsylo - Physics aware representation for drug discovery
  • [BSc] Michał Soboszek - Evaluating word embeddings
  • [Defended, MSc] Jakub Chłędowski - Representation learning for textual entailment

Selected publications

Logo image

Residual Connections Encourage Iterative Inference

S. Jastrzębski*, D. Arpit*, N. Ballas, V. Verma, T. Che, Y. Bengio

International Conference on Learning Representations 2018
.pdf

Logo image

A Closer Look at Memorization in Deep Networks

D. Arpit*, S. Jastrzębski*, N. Ballas*, D. Krueger*, T. Maharaj, E. Bengio, A. Fischer, A. Courville, S. Lacoste-Julien, Y. Bengio

International Conference on Machine Learning 2017
.pdf poster slides

Logo image

Learning to Compute Word Embeddings on The Fly

D. Bahdanau, T. Bosc*, S. Jastrzębski*, E. Grefenstette, P. Vincent, Y. Bengio

Montreal AI Symposium 2017
code .pdf poster

Logo image

Three factors influencing minima in SGD

S. Jastrzębski*, Z. Kenton*, D. Arpit, N. Ballas, A. Fischer, Y. Bengio, A. Storkey

International Conference on Learning Representations 2018 (workshop track)
.pdf

Logo image

Quo vadis G Protein-Coupled Receptor ligands? A tool for analysis of the emergence of new groups of compounds over time

D. Lesniak, S. Jastrzębski, W. M. Czarnecki, S. Podlewska, A. Bojarski

Bioorganic & Medicinal Chemistry Letters, 2017
.pdf

Logo image

Learning to SMILE(S)

S. Jastrzębski, D. Lesniak, W. M. Czarnecki

International Conference on Learning Representations 2016 (workshop track)
.pdf poster

Logo image

How to evaluate word embeddings? On importance of data efficiency and simple supervised tasks

S. Jastrzębski, D. Lesniak, W. M. Czarnecki

.pdf

Logo image

Active Learning of Compounds Activity–Towards Scientifically Sound Simulation of Drug Candidates Identification

W. M. Czarnecki, S. Jastrzębski, I. Sieradzki, S. Podlewska

MLLS workshop, ECML 2015
code .pdf slides

Logo image

Analysis of compounds activity concept learned by SVM using robust Jaccard based low-dimensional embedding

S. Jastrzębski, W. M. Czarnecki

TFML 2015
code .pdf slides

Logo image

Density Invariant Detection of Osteoporosis Using Growing Neural Gas

I. T. Podolak, S. Jastrzębski

CORES 2013
code slides

Short CV

Logo image

MILA

Research intern supervised by prof. Yoshua Bengio

2017, Montreal, Canda

Logo image

MILA

Research intern supervised by prof. Yoshua Bengio

2016, Montreal, Canda

Logo image

Palantir

Machine Learning intern, fraud detection models and Deep NLP applications

2016, London, UK

Logo image

University of Edinburgh

Research intern, Deep Learning for Go, under the supervision of prof. Amos Storkey

2015, Edinburgh, UK

Logo image

Palantir

SDE intern, distributed data systems

2015, Palo Alto, USA

Logo image

Microsoft

SDE intern, API research and design

2014, Redmond, USA

Logo image

wide.io

SDE intern, data processing framework development

2013, London, UK

Code

Logo image

Word Embeddings Benchmarks

Python package for evaluating word embeddings.

github

Logo image

GMUM.R

ML algorithms C++ implementations for R, including online clustering, swappable SVM library interface and new clustering algorithm.

github url

Logo image

KrakRobot Simulator

Simulator for 2015 and 2016 editions online qualification round.

github url

Talks

Logo image

Optimization in Deep Learning

Lecture @ GMUM Deep Learning Workshop

2018, Cracow, Poland
slides

Logo image

Understanding How Deep Networks Learn

Invited talk @ PL in ML

2017, Warsaw, Poland
slides video