Altman: “Controlled Markov
chains under constraints''; Ph.D., June 1990. Currently Director of Research, INRIA, Sophia
Antipolis and Invited Professor at the
Nahum Shimkin: “Stochastic Control of Distributed Systems''; Ph.D., April 1992. Currently Associate Professor, Electrical Engineering, Technion. For papers describing this and later joint work see my cv.
“Recursive methods for identification in continuous-time stochastic
Processes''; Ph.D., May 1992. Co-advisor: Prof. O. Zeitouni. Currently Senior
Lecturer, Electrical and Computer Engineering,
Michael Nehorai: “Recursive estimation in Semi-Markov models," M.Sc., June 1990.
Rachel Levi: “A theory of approachability and throughput-delay tradeoff in a queue with impatient customers," M.Sc., June 1994. For the paper describing this work see my cv.
Mathew Jacobson: “Two
time scale Markov Decision processes." M.Sc., October 1994--February 1999.
(Co-advisor, together with Nahum Shimkin.) For the
paper describing this work see my cv. This is also
described in greater details in two reports: Part I (ps, pdf)
and part II (ps, pdf). Mathew obtained his Ph.D. from
Zadorojniy: Constrained Markov decision processes
with applications to wireless communications. 2003- June 2004. For the
paper describing this work see my cv. Now a Ph.D.
student, Electrical Engineering,
Maxim Ioresh: Large deviations for a polling system with exhaustive service. October 2003—August 2005.
Yair Carmon wrote a report as part of a "personal topics" or "advanced topics" course: "Markov decision processes with general discount functions", completed November 2007.