Verifiably Safe Reinforcement Learning

Nathan Hunt, Nathan Fulton, Subhro Das, Nghia Hoang. Formal Verification of End-to-End Learning in Cyber-Physical Systems: Progress and Challenges NeurIPS-2019 Workshop on Safety and Robustness in Decision Making, Vancouver, BC, CA.

Nathan Fulton and André Platzer. Verifiably Safe Off-Model Reinforcement Learning. Tools and Algorithms for the Construction and Analysis of Systems (TACAS’19), Held as part of the European Joint Conferences on Theory and Practice of Software (ETAPS’19).

Nathan Fulton and André Platzer. Safe AI for CPS. International Test Conference, ITC’18. (Invited paper)
PDF | bib

Nathan Fulton and André Platzer. Safe Reinforcement Learning via Formal Methods: Toward Safe Control Through Proof and Learning. Proceedings of the 32nd AAAI International Conference on Artificial Intelligence, AAAI’18, New Orleans, LA, USA. (oral presentation)
PDF | slides | bib

Deductive Theorem Proving for Hybrid Dynamical Systems

Nathan Fulton, Stefan Mitsch, Brandon Bohrer, André Platzer. Bellerophon: Tactical Theorem Proving for Hybrid Systems. In Proceedings of the 8th International Conference on Interactive Theorem Proving, ITP’17, Brasília, Brazil.
PDF | Slides | Language Implementation | Standard Library Implementation | bib

Nathan Fulton, André Platzer. A Logic of Proofs for Differential Dynamic Logic: Toward Independently Checkable Proof Certificates for Dynamic Logics. In Proceedings of The 5th ACM SIGPLAN Conference on Certified Programs and Proofs, CPP’16, St. Petersburg, FL, USA.
PDF | Slides | bib

Nathan Fulton, Stefan Mitsch, Jan-David Quesel, Marcus Völp, André Platzer. KeYmaera X: An Axiomatic Tactical Theorem Prover for Hybrid Systems. In the International Conference on Automated Deduction, CADE’15, Berlin, DE.
PDF | Slides | Poster | Implementation | bib

Cyber-Physical Systems Case Studies

Viren Bajaj, Karim Elmaaroufi, Nathan Fulton, André Platzer. Verifiably Safe SCUBA Diving with Commodity Sensors. WiP track at the ACM SIGBED International Conference on Embedded Software (EMSOFT’19), New York, NY, USA.
PDF | github

Language-Based Security

Nathan Fulton, Cyrus Omar, Jonathan Aldrich. Statically Typed String Sanitation Inside a Python. In the First International Workshop on Privacy and Security in Programming. (Best Paper Award)
PDF | Poster | Slides | bib

Nathan Fulton, Cyrus Omar, Jonathan Aldrich. Statically Typed String Sanitation Inside a Python. CMU-ISR-14-112. In ISR Technical Reports 2014. Carnegie Mellon University (Technical Report).
PDF | canonical citation

Nathan Fulton. Security Through Extensible Type Systems. SPLASH’12 Student Research Competition (Second Place).
PDF | canonical citation


Nathan Fulton. Verifiably Safe Autonomy for Cyber-Physical Systems. Computer Science Department, Carnegie Mellon University.

Nathan Fulton. A Typed Lambda Calculus for Input Sanitation. In Selected Mathematics Senior Theses for the 2012-2013 Academic Year. Carthage College.
PDF | canonical citation

Other Talks and Presentations

I have given several talks and presentations that were not associated with a paper published in a formal proceedings.

A Formal Methods Perspective on Safe Reinforcement Learning (Invited Talk). Formal Methods for the Informal Engineer. The Broad Institute of Harvard and MIT. March 19-20, 2020.

End-to-End Verification of Intelligent Cyber-Physical Systems: Progress and Challenges (Invited Talk). Interactive Workshop on the Industrial Application of Verification and Testing. Prague, Czech Republic. 2019. Slides available on request.

Safe Reinforcement Learning. Presented at SUNY-Stony Brook. 2018.

Safe Reinforcement Learning. Presented at the Security seminar at Columbia University. New York City, New York, USA. 2018.

Safe Reinforcement Learning. Presented at the 3rd Conference on Artificial Intelligence and Theorem Proving. Aussois, France. March 2018.
Slides | canonical citation

Marktoberdorf Tutorial on KeYmaera X. Presented at Summer School Marktoberdorf 2017: Logical Methods for Safety and Security of Software Systems. Marktoberdorf, Garmany. August 2017.
Slides | Other Resources

Reachability Analysis in the KeYmaera X Theorem Prover. Presented at the Third International Workshop on Symbolic and Numerical Methods. Uppsala, Sweden. April 2017.

Automatic Incremental Robustification for Hybrid Systems. Presented at the Dagstuhl Seminar on Robustness for Cyber-Phyiscal Systems. Dagstuhl, Germany. September 2016.