<?xml version="1.0" encoding="UTF-8"?>
<mods xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.loc.gov/mods/v3" version="3.1" xsi:schemaLocation="http://www.loc.gov/mods/v3 http://www.loc.gov/standards/mods/v3/mods-3-1.xsd">
  <titleInfo>
    <title>Discrete Stochastic Processes</title>
    <subTitle>Tools for Machine Learning and Data Science</subTitle>
  </titleInfo>
  <name type="personal">
    <namePart>Privault, Nicolas.</namePart>
    <role>
      <roleTerm authority="marcrelator" type="text">creator</roleTerm>
    </role>
    <role>
      <roleTerm type="text">author.</roleTerm>
    </role>
    <role>
      <roleTerm authority="marcrelator" type="code">aut</roleTerm>
    </role>
    <role>
      <roleTerm authority="marcrelator" type="code">http://id.loc.gov/vocabulary/relators/aut</roleTerm>
    </role>
  </name>
  <name type="corporate">
    <namePart>SpringerLink (Online service)</namePart>
  </name>
  <typeOfResource>text</typeOfResource>
  <originInfo>
    <place>
      <placeTerm type="code" authority="marccountry">sz</placeTerm>
    </place>
    <dateIssued encoding="marc">2024</dateIssued>
    <edition>1st ed. 2024.</edition>
    <issuance>monographic</issuance>
  </originInfo>
  <language>
    <languageTerm authority="iso639-2b" type="code">eng</languageTerm>
  </language>
  <physicalDescription>
    <form authority="marcform">electronic</form>
    <form authority="gmd">electronic resource</form>
    <reformattingQuality>access</reformattingQuality>
    <extent>XII, 288 p. 144 illus., 130 illus. in color. online resource.</extent>
  </physicalDescription>
  <abstract>This text presents selected applications of discrete-time stochastic processes that involve random interactions and algorithms, and revolve around the Markov property. It covers recurrence properties of (excited) random walks, convergence and mixing of Markov chains, distribution modeling using phase-type distributions, applications to search engines and probabilistic automata, and an introduction to the Ising model used in statistical physics. Applications to data science are also considered via hidden Markov models and Markov decision processes. A total of 32 exercises and 17 longer problems are provided with detailed solutions and cover various topics of interest, including statistical learning.</abstract>
  <tableOfContents>- 1. A Summary of Markov Chains -- 2. Phase-Type Distributions -- 3. Synchronizing Automata -- 4. Random Walks and Recurrence -- 5. Cookie-Excited Random Walks -- 6. Convergence to Equilibrium -- 7. The Ising Model -- 8. Search Engines -- 9. Hidden Markov Model -- 10. Markov Decision Processes.</tableOfContents>
  <note type="statement of responsibility">by Nicolas Privault.</note>
  <subject authority="lcsh">
    <topic>Stochastic processes</topic>
  </subject>
  <subject authority="lcsh">
    <topic>Computer science</topic>
    <topic>Mathematics</topic>
  </subject>
  <subject>
    <topic>Stochastic Processes</topic>
  </subject>
  <subject>
    <topic>Mathematical Applications in Computer Science</topic>
  </subject>
  <classification authority="lcc">QA274-274.9</classification>
  <relatedItem type="host">
    <titleInfo>
      <title>Springer Nature eBook</title>
    </titleInfo>
  </relatedItem>
  <relatedItem type="otherFormat" displayLabel="Printed edition:"/>
  <relatedItem type="otherFormat" displayLabel="Printed edition:"/>
  <relatedItem type="series">
    <titleInfo>
      <title>Springer Undergraduate Mathematics Series</title>
    </titleInfo>
  </relatedItem>
  <identifier type="isbn">9783031658204</identifier>
  <identifier type="uri">https://doi.org/10.1007/978-3-031-65820-4</identifier>
  <location>
    <url>https://doi.org/10.1007/978-3-031-65820-4</url>
  </location>
  <recordInfo>
    <recordCreationDate encoding="marc">241008</recordCreationDate>
    <recordChangeDate encoding="iso8601">20251030113132.0</recordChangeDate>
    <recordIdentifier source="DE-He213">978-3-031-65820-4</recordIdentifier>
  </recordInfo>
</mods>
