Pill

Optimization Based Modelling

Optimization layers allow incorporating downstream optimization problems into neural network training. The performance gap between the …

Faried Abu Zaid
Pill

DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

External knowledge can be injected into pre-trained language models (here specifically BERT) by training an additional language model on …

Michael Panchenko
Large Language Models
Pill

Towards Generative Modelling of Multivariate Extremes and Tail Dependence

Modeling heavy-tailed marginal distributions and asymmetric tail dependence with normalizing flows and copula theory.

Faried Abu Zaid
Probabilistic Models
Blog

Our take on IJCAI 2022

The International Joint Conference on Artificial Intelligence (IJCAI) is a premier event for researchers working in all areas of AI.

Faried Abu Zaid
Pill

Neuro Symbolic Verification of Deep Neural Networks

The neuro-symbolic approach to verification of neural networks uses reference networks to represent high level concepts. This allows the …

Faried Abu Zaid
Formal Verification Under Uncertainty
Pill

Probabilistic Inference With Algebra and Logic Constraints

Hybrid probabilistic inference allows performing probabilistic inference with algebra and logic constraints. Recent advances with emphasis …

Faried Abu Zaid
Formal Verification Under Uncertainty