Publications and preprints

Research

My research spans post-training and alignment for large language models, machine learning theory, and differential privacy.

Shiva Kasiviswanathan speaking at the Agentic AI Summit
Principal Applied Scientist Amazon, Bay Area, California

Preprints

  1. Preprint

    Sample Complexity of Multicalibration for Multilevel Properties

    With J. Lu, K. Balasubramanian, and A. Podkopaev

  2. Preprint
  3. Preprint
  4. Preprint

    Debiasing Reward Models via Identifiable Causal Representations

    With I. Ng, P. Bloebaum, S. Bhandari, and K. Zhang

  5. Preprint

    Optimal Transportation and Alignment Between Gaussian Measures

    With S. Dandapanthula, A. Podkopaev, A. Ramdas, and Z. Goldfeld

  6. Preprint
  7. Preprint
  8. Preprint

    What Causes Postoperative Aspiration?

    With S. Nagesh, K, Covarrubias, R. El-Kareh, and N. Mishra

  9. Preprint
  10. Preprint

Published papers

  1. ICML 2026

    Dependence-Aware Label Aggregation for LLM-as-a-Judge via Ising Models

    With K. Balasubramanian and A. Podkopaev

    In proceedings of ICML 2026

  2. ICLR 2026
  3. ICLR 2026

    Learning to Answer from Correct Demonstrations

    With N. Joshi, G. Li, S. Bhandari, C. Ma, and N. Srebro

    In proceedings of ICLR 2026

  4. AISTATS 2026

    From Guess2Graph: When and How Can Unreliable Experts Safely Boost Causal Discovery in Finite Samples?

    With S. Hiremath, D. Janzing, P. Faller, P. Blobaum, E. Kirschbaum, and K. Gan

    In proceedings of AISTATS 2026

  5. ICLR 2025

    QA-Calibration of Language Model Confidence Scores

    With P. Manggala, A. Mastakouri, E. Kirschbaum, and A. Ramdas

    In proceedings of ICLR 2025

  6. TMLR 2024

    Modeling Causal Mechanisms with Diffusion Models for Interventional and Counterfactual Queries

    With P. Chao, P. Bloebaum, and S. Patel

    In Transactions on Machine Learning Research 2024

    Preliminary version in ICML Workshop: Could it have been different? Counterfactuals in Minds and Machines, 2023

  7. AISTATS 2024

    Differentially Private Conditional Independence Testing

    With I. Kalemaj and A. Ramdas

    In proceedings of AISTATS 2024

  8. CLeaR 2024

    The PetShop Dataset — Finding Causes of Performance Issues across Microservices

    With M. Hardt, W. Orchard, P. Bloebaum, and E. Kirschbaum

    In proceedings of CLeaR 2024

  9. NeurIPS 2023

    Debiasing Conditional Stochastic Optimization

    With L. He

    In proceedings of NeurIPS 2023

  10. ICML 2023

    Thompson Sampling with Diffusion Generative Prior

    With Y. Hsieh, B. Kveton, and P. Bloebaum

    In proceedings of ICML 2023

  11. ICML 2023

    Sequential Kernelized Independence Testing

    With A. Podkopaev, P. Bloebaum, and A. Ramdas

    In proceedings of ICML 2023

  12. NeurIPS 2022

    Uplifting Bandits

    With Y. Hsieh and B. Kveton

    In proceedings of NeurIPS 2022

  13. ICML 2022

    On Measuring Causal Contributions via do-interventions

    With Y. Jung, J. Tian, D. Janzing, P. Bloebaum, and E. Bareinboim

    In proceedings of ICML 2022

  14. UAI 2022

    Balancing Utility and Scalability in Metric Differential Privacy

    With J. Imola, S. White, A. Aggarwal, and N. Teissier

    In proceedings of UAI 2022

  15. AISTATS 2022

    Reconstructing Test Labels from Noisy Loss Functions

    With A. Aggarwal, Z. Xu, O. Feyisetan, and N. Teissier

    In proceedings of AISTATS 2022

  16. NeurIPS 2021

    Collaborative Causal Discovery with Atomic Interventions

    With R. Addanki

    In proceedings of NeurIPS 2021

  17. ICML 2021

    Label Inference Attacks from Log-loss Scores

    With A. Aggarwal, Z. Xu, O. Feyisetan, and N. Teissier

    In proceedings of ICML 2021 (selected for long oral presentation)

  18. ICML 2021

    Federated Learning under Arbitrary Communication Patterns

    With Dmitrii Avdyukhin

    In proceedings of ICML 2021

  19. UAI 2021
  20. TrustNLP 2021

    Private Release of Text Embedding Vectors

    With O. Feyisetan

    In proceedings of First Workshop on Trustworthy Natural Language Processing (part of ACL 2021)

  21. Paper
  22. ICML 2020

    Efficient Intervention Design for Causal Discovery with Latents

    With R. Addanki, A. McGregor, and C. Musco

    In proceedings of ICML 2020

  23. AISTATS 2020

    Contextual Online False Discovery Rate Control

    With S. Chen

    In proceedings of AISTATS 2020

  24. JPC 2020

    Subsampled Renyi Differential Privacy and Analytical Moments Accountant

    With Y. Wang and B. Balle

    In proceedings of AISTATS 2019 (selected for oral presentation)

    Winner of Notable Paper Award at AISTATS 2019

    Full version, In Journal of Privacy and Confidentiality, 2020

    Preliminary versions in PPML 2018 and TPDP 2018 - Theory and Practice of Differential Privacy

  25. COLT 2018
  26. ICML 2018

    Semi-Supervised Learning on Data Streams via Temporal Label Propagation

    With T. Wagner, S. Guha, and N. Mishra

    In proceedings of ICML 2018

  27. IJCAI 2018

    Network Approximation using Tensor Sketching

    With N. Narodytska and H. Jin

    In proceedings of IJCAI 2018

    Preliminary version in NIPS 2016 Workshop on Deep Learning: Bridging Theory and Practice

    Full version of this paper can be found here

  28. AAAI 2018

    Verifying Properties of Binarized Deep Neural Networks

    With N. Narodytska, L. Ryzhyk, M. Sagiv, and T. Walsh

    In proceedings of AAAI 2018

  29. CVPRW 2017

    Simple Black-Box Adversarial Attacks on Deep Neural Networks

    With N. Narodytska

    In proceedings of CVPR 2017 Workshops

    Preliminary version appeared at the NIPS 2016 Workshop on Adversarial Training

  30. PODS 2017

    Private Incremental Regression

    With K. Nissim and H. Jin

    In proceedings of PODS 2017

  31. ICML 2016
  32. VLDB 2016

    Streaming Anomaly Detection Using Randomized Matrix Sketching

    With H. Huang

    In proceedings of VLDB 2016

  33. ICDE 2016

    Streaming Spectral Clustering

    With S. Yoo and H. Huang

    In proceedings of ICDE 2016

  34. ICDE 2016

    Private Spatial Data Aggregation in the Local Setting

    With R. Chen, H. Li, A.K. Win, and H. Jin

    In proceedings of ICDE 2016

    Invited to IEEE Transactions on Knowledge and Data Engineering (special issue)

  35. RANDOM 2015

    Spectral Norm of Random Kernel Matrices with Applications to Privacy

    With M. Rudelson

    In proceedings of RANDOM 2015

  36. CIKM 2015

    Unsupervised Feature Selection on Data Streams

    With H. Huang and S. Yoo

    In proceedings of CIKM 2015

  37. AAAI 2015

    Online Dictionary Learning on Symmetric Positive Definite Manifolds with Vision Applications

    With S. Zhang, P. Yuen, and M. Harandi

    In proceedings of AAAI 2015

    Associated code can be found here: here

  38. JPC 2014
  39. MLJ 2014

    Bounds on the Sample Complexity for Private Learning and Private Data Release

    With A. Beimel, H. Brenner, and K. Nissim

    In Machine Learning Journal, 2014

    Earlier version appeared in proceedings of TCC 2010

  40. SODA 2013

    The Power of Linear Reconstruction Attacks

    With M. Rudelson and A. Smith

    In proceedings of SODA 2013

  41. TCC 2013

    Analyzing Graphs with Node Differential Privacy

    With K. Nissim, S. Raskhodnikova, and A. Smith

    In proceedings of TCC 2013

    Full version of this paper can be found here

  42. ICASSP 2013

    Fast Online L1-Dictionary Learning Algorithms For Novel Document Detection

    In proceedings of ICASSP 2013 (Invited Presentation)

    Special session on Sparse Signal Techniques for Web Information Processing

  43. IBMJ 2013

    Novel Document Detection on Massive Data Streams using Distributed Dictionary Learning

    With G. Cong, P. Melville, and R. Lawrence

    In IBM Journal of Research and Development, 2013

  44. CPC 2014

    Approximately Counting Embeddings into Random Graphs

    With M. Furer

    In Combinatorics, Probability & Computing, 2014 (special issue on Analysis of Algorithms)

    Earlier version appeared in proceedings of RANDOM 2008

  45. TCS 2013

    An Exponential Time 2-Approximation Algorithm for Bandwidth

    With M. Furer and S. Gaspers

    In Theoretical Computer Science, 2013 (special issue on Exact & Parameterized Computation)

    Earlier version appeared in proceedings of IWPEC 2009

  46. NIPS 2012

    Online L1-Dictionary Learning with Application to Novel Document Detection

    With H. Wang, A. Banerjee, and P. Melville

    In proceedings of NIPS 2012

    Full version of this paper can be found here

    Preliminary version appeared at the KDD SOMA Workshop 2012

  47. ICML 2012

    Efficient and Practical Stochastic Subgradient Descent for Nuclear Norm Regularization

    With H. Avron, S. Kale, and V. Sindhwani

    In proceedings of ICML 2012

  48. CIKM 2011

    Emerging Topic Detection Using Dictionary Learning

    With P. Melville, A. Banerjee, and V. Sindhwani

    In proceedings of CIKM 2011

    Full version of this paper can be found here

  49. INFOCOM 2011

    Geography-Based Analysis of the Internet Infrastructure

    With S. Eidenbenz and G. Yan

    In proceedings of IEEE INFOCOM (mini-conference) 2011

    Full version of this paper can be found here

  50. SODA 2011

    The Rigidity Transition for Random Graphs

    With C. Moore and L. Theran

    In proceedings of SODA 2011

  51. MILCOM 2011
  52. SICOMP 2011

    What Can We Learn Privately?

    With H. K. Lee, K. Nissim, S. Raskhodnikova, and A. Smith

    In SIAM Journal on Computing, 2011 (special issue for selected papers from FOCS 2008)

    Earlier version appeared in proceedings of FOCS 2008

  53. STOC 2010

    The Price of Privately Releasing Contingency Tables and the Spectra of Random Matrices with Correlated Rows

    With M. Rudelson, A. Smith, and J. Ullman

    In proceedings of ACM STOC 2010

    Full version of this paper can be found here

  54. CPAIOR 2010

    Matrix Interdiction Problem

    With F. Pan

    In proceedings of CPAIOR 2010

  55. PADS 2010

    Spatial Scattering for Load Balancing in Conservatively Synchronized Parallel Discrete-Event Simulations

    With S. Thulasidasan, S. Eidenbenz, and P. Romero

    In proceedings of ACM/IEEE/SCS PADS 2010

  56. PMC 2011

    Bandwidth Provisioning in Infrastructure based Wireless Networks Employing Directional Antennas

    With B. Zhao, B. Urgaonkar, and S. Vasudevan

    In Pervasive and Mobile Computing, 2011 (special issue for selected papers from ICDCN 2010)

    Earlier version appeared in proceedings of ICDCN 2010

  57. HIPC 2009

    Designing Systems for Large-Scale, Discrete-Event Simulations: Experiences with the FastTrans Microsimulator

    With S. Thulasidasan, S. Eidenbenz, E. Galli, S. Mniszewski, and P. Romero

    In proceedings of IEEE HIPC 2009

  58. KDD 2008

    Composition Attacks and Auxiliary Information in Data Privacy

    With S. R. Ganta and A. Smith

    In proceedings of ACM SIGKDD 2008

  59. THESIS 2008

    Approximation Algorithms for Graph Problems (please email me for a copy)

    Ph.D. Thesis, Penn State University, 2008

  60. SPAA 2007

    Packing to Angles and Sectors

    With P. Berman, J. Jeong, and B. Urgaonkar

    In proceedings of ACM SPAA 2007

  61. JCG 2012

    Spanners for Geometric Intersection Graphs with Applications

    With M. Furer

    In Journal of Computational Geometry, 2012

    Earlier version appeared in proceedings of WADS 2007

  62. WADS 2007

    Faster Approximation of Distances in Graphs

    With P. Berman

    In proceedings of WADS 2007

  63. SOFSEM 2007

    Exact Max 2-SAT: Easier and Faster

    With M. Furer

    In proceedings of SOFSEM 2007

    Winner of best paper award

  64. WAOA 2006

    Approximate Distance Queries in Disk Graphs

    With M. Furer

    In proceedings of WAOA 2006

  65. JCO 2006

    Combinatorics of TCP Reordering

    With A. Hansson and G. Istrate

    In Journal of Combinatorial Optimization, 2006

  66. ANALCO 2005

    Approximately Counting Perfect Matchings in General Graphs

    With M. Furer

    In proceedings of SIAM ALENEX/ANLACO 2005

  67. AAIM 2007

    Algorithms for Counting 2-SAT Solutions and Colorings with Applications

    With M. Furer

    In proceedings of AAIM 2007

    Full version appeared as ECCC report TR05-033, 2005

  68. FSTTCS 2004