Teoriya Veroyatnostei i ee Primeneniya
RUS  ENG    JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB  
General information
Latest issue
Archive
Impact factor
Guidelines for authors
Submit a manuscript

Search papers
Search references

RSS
Latest issue
Current issues
Archive issues
What is RSS



Teor. Veroyatnost. i Primenen.:
Year:
Volume:
Issue:
Page:
Find






Personal entry:
Login:
Password:
Save password
Enter
Forgotten password?
Register


Teoriya Veroyatnostei i ee Primeneniya, 1965, Volume 10, Issue 1, Pages 3–18 (Mi tvp434)  

This article is cited in 49 scientific papers (total in 49 papers)

Controlled Stochastic Processes – Discrete Parameter

E. B. Dynkin

Moscow
Received: 17.09.1964
English version:
Theory of Probability and its Applications, 1965, Volume 10, Issue 1, Pages 1–14
DOI: https://doi.org/10.1137/1110001
Bibliographic databases:
Language: Russian
Citation: E. B. Dynkin, “Controlled Stochastic Processes – Discrete Parameter”, Teor. Veroyatnost. i Primenen., 10:1 (1965), 3–18; Theory Probab. Appl., 10:1 (1965), 1–14
Citation in format AMSBIB
\Bibitem{Dyn65}
\by E.~B.~Dynkin
\paper Controlled Stochastic Processes~-- Discrete Parameter
\jour Teor. Veroyatnost. i Primenen.
\yr 1965
\vol 10
\issue 1
\pages 3--18
\mathnet{http://mi.mathnet.ru/tvp434}
\mathscinet{http://mathscinet.ams.org/mathscinet-getitem?mr=173581}
\zmath{https://zbmath.org/?q=an:0137.35801}
\transl
\jour Theory Probab. Appl.
\yr 1965
\vol 10
\issue 1
\pages 1--14
\crossref{https://doi.org/10.1137/1110001}
Linking options:
  • https://www.mathnet.ru/eng/tvp434
  • https://www.mathnet.ru/eng/tvp/v10/i1/p3
  • This publication is cited in the following 49 articles:
    1. Eugene A. Feinberg, Sayaka Ishizawa, Pavlo O. Kasyanov, David N. Kraemer, 2024 IEEE 63rd Conference on Decision and Control (CDC), 2024, 4052  crossref
    2. Eugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky, “Semi-uniform Feller Stochastic Kernels”, J Theor Probab, 36:4 (2023), 2262  crossref
    3. Eugene A. Feinberg, Pavlo O. Kasyanov, “Equivalent conditions for weak continuity of nonlinear filters”, Systems & Control Letters, 173 (2023), 105458  crossref
    4. Eugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky, “Markov Decision Processes with Incomplete Information and Semiuniform Feller Transition Probabilities”, SIAM J. Control Optim., 60:4 (2022), 2488  crossref
    5. Sara Sharifi, Shahram Shahbazpanahi, Min Dong, “A POMDP-Based Antenna Selection for Massive MIMO Communication”, IEEE Trans. Commun., 70:3 (2022), 2025  crossref
    6. Jan H. van Schuppen, Communications and Control Engineering, Control and System Theory of Discrete-Time Stochastic Systems, 2021, 547  crossref
    7. Eugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky, 2021 60th IEEE Conference on Decision and Control (CDC), 2021, 1615  crossref
    8. P. Battigalli, A. Francetich, G. Lanzani, M. Marinacci, “Learning and self-confirming long-run biases”, Journal of Economic Theory, 183 (2019), 740  crossref
    9. Feinberg E.A., Kasyanov P.O., Zgurovsky M.Z., “Uniform Fatou's lemma”, J. Math. Anal. Appl., 444:1 (2016), 550–567  crossref  mathscinet  zmath  isi  elib  scopus
    10. Feinberg E.A., Kasyanov P.O., Zgurovsky M.Z., “Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities”, Math. Oper. Res., 41:2 (2016), 656–681  crossref  mathscinet  zmath  isi  elib  scopus
    11. Eugene A. Feinberg, Optimization Challenges in Complex, Networked and Risky Systems, 2016, 14  crossref
    12. Proc. Steklov Inst. Math., 287:1 (2014), 96–117  mathnet  crossref  crossref  isi  elib
    13. Eugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky, 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), 2014, 1  crossref
    14. Markov Processes for Stochastic Modeling, 2013, 481  crossref
    15. Matthijs T. J. Spaan, Adaptation, Learning, and Optimization, 12, Reinforcement Learning, 2012, 387  crossref
    16. Florian Weissel, Thomas Schreiter, Marco F. Huber, Uwe D. Hanebeck, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, 2008, 40  crossref
    17. Ross B Corotis, J Hugh Ellis, Mingxiang Jiang, “Modeling of risk-based inspection, maintenance and life-cycle cost with partially observable Markov decision processes”, Structure and Infrastructure Engineering, 1:1 (2005), 75  crossref
    18. Guy Jumarie, Maximum Entropy, Information Without Probability and Complex Fractals, 2000, 230  crossref
    19. Martin Mundhenk, Judy Goldsmith, Christopher Lusena, Eric Allender, “Complexity of finite-horizon Markov decision process problems”, J. ACM, 47:4 (2000), 681  crossref
    20. Wiley Series in Probability and Statistics, Markov Decision Processes, 1994, 613  crossref
    Citing articles in Google Scholar: Russian citations, English citations
    Related articles in Google Scholar: Russian articles, English articles
    Теория вероятностей и ее применения Theory of Probability and its Applications
    Statistics & downloads:
    Abstract page:425
    Full-text PDF :198
    First page:2
     
      Contact us:
     Terms of Use  Registration to the website  Logotypes © Steklov Mathematical Institute RAS, 2025