Urtzi Ayesta

Ikerbasque Research Professor, UPV/EHU

Ikerbasque research professor at the Computer Science Department of the UPV/EHU, and CNRS Director of Research at IRIT.

Research line:

Stochastic processes, optimization, control theory and their applications to communication systems and networking.

Previous research experience at the BCAM - Basque Center for Applied Mathematics, CWI- Center for Mathematics and Informatics (the Netherlands) and France Telecom R&D and INRIA (France).

Doctor in Computer Science (2005).

Argitalpenak
Kongresuak eta Proceedings

2024

Article / Efficient reinforcement learning with Fleming-Viot particle systems: application to stochastic networks with rarely observed rewards

Stochastic Systems

D. Mastropietro, U. Ayesta, M. Jonckheere, S. Majewski

Article / Tabular and Deep Learning for the Whittle Index

ACM Transactions on Modeling and Performance Evaluation of Computing Systems

Relaño, F.R.; Borkar, V.; Ayesta, U.; Avrachenkov, K.

2023

Article / Price of Anarchy with multiple information sources under competition

Operations Research Letters

Miguelez, F.; Ayesta, U.; Doncel, J.

2022

Article / On the Whittle index of Markov modulated restless bandits

Queueing Systems

Duran, S.; Ayesta, U.; Verloop, I.M.

Article / A Token-Based Central Queue with Order-Independent Service Rates

Operations Research

Ayesta, U.; Bodas, T.; Dorsman, J.P.L.; Verloop, I.M.

Letter / Reinforcement learning in queues

Queueing Systems

Ayesta, U.

2021

Chapter / A Survey of Stability Results for Redundancy Systems

in Alexey B. Piunovskiy and Yi Zhang (eds.), Modern Trends in Controlled Stochastic Processes: Theory and Applications, V.III. Springer US, 2021.

E. Anton, U. Ayesta, M. Jonckheere, I.M. Verloop

Article / A token-based central queue with order-independent service rates

Operations Research

U. Ayesta, T. Bodas, J.P. Dorsman, I.M. Verloop

Article / A Resource Sharing Game for the Freshness of Status Updates

Performance Evaluation Review

Migúelez, F.; Doncel, J.; Ayesta, U.

Article / On the stability of redundancy models

Operations Research

Anton, E.; Ayesta, U.; Jonckheere, M.; Verloop, I.M.

Article / On the computation of Whittle’s index for Markovian restless bandits

Mathematical Methods of Operations Research

Ayesta, U.; Gupta, M.K.; Verloop, I.M.

2020

Article / On the stability of redundancy models

To appear in Operations Research

E. Anton, U. Ayesta, M. Jonckheere, I.M. Verloop

Article / Improving the performance of heterogeneous data centers through redundancy

Proceedings of ACM POMACS

E. Anton, U. Ayesta, M. Jonckheere, I.M. Verloop,

Article / SCHEDULING in A SINGLE-SERVER QUEUE with STATE-DEPENDENT SERVICE RATES

Probability in the Engineering and Informational Sciences

Ayesta, U.; Prabhu, B.; Righter, R.

2019

Article / Performance analysis of space–time priority queues

Performance Evaluation

Carballo-Lozano, C.; Ayesta, U.; Fiems, D.

Article / Performance Degradation in Parallel-Server Systems

IEEE/ACM Transactions on Networking

Doncel, J.; Aalto, S.; Ayesta, U.

2018

Article / On a unifying product form framework for redundancy models

Performance Evaluation

Ayesta, U.; Bodas, T.; Verloop, I.M.

2017

Article / Scheduling of multi-class multi-server queueing systems with abandonments

Journal of Scheduling

Ayesta, U.; Jacko, P.; Novak, V.

2016

Article / Dynamic Control of Birth-and-Death Restless Bandits: Application to Resource-Allocation Problems

IEEE/ACM Transactions on Networking

Larrnaaga, M.; Ayesta, U.; Verloop, I.M.

2015

Article / Asymptotically optimal index policies for an abandonment queue with convex holding cost

Queueing Systems

Larrañaga, M.; Ayesta, U.; Verloop, I.M.

Article / Interpolation approximations for the steady-state distribution in multi-class resource-sharing systems

Performance Evaluation

Izagirre, A.; Ayesta, U.; Verloop, I.M.

Article / HEAVY-TRAFFIC ANALYSIS OF A NON-PREEMPTIVE MULTI-CLASS QUEUE WITH RELATIVE PRIORITIES

Probability in the Engineering and Informational Sciences

Izagirre, A.; Verloop, I.M.; Ayesta, U.

2014

Article / A resource-sharing game with relative priorities

Performance Evaluation

Doncel, J.; Ayesta, U.; Brun, O.; Prabhu, B.

2013

Article / Congestion control of TCP flows in Internet routers by means of index policy

Computer Networks

Avrachenkov, K.; Ayesta, U.; Doncel, J.; Jacko, P.

Article / Dynamic fluid-based scheduling in a multi-class abandonment queue

Performance Evaluation

Larrañaga, M.; Ayesta, U.; Verloop, I.M.

Article / QoE-aware optimization of multimedia flow scheduling

Computer Communications

Taboada, I.; Liberal, F.; Fajardo, J.O.; Ayesta, U.

Article / Scheduling in a random environment: Stability and asymptotic optimality

IEEE/ACM Transactions on Networking

Ayesta, U.; Erausquin, M.; Jonckheere, M.; Verloop, I.M.

2012

Article / Technical vulnerability of the E-UTRA paging mechanism,

Proceedings of IEEE WCNC 2012

A. Bareav, U. Ayesta, I.M. Verloop, D. Miorandi, I. Chlamtac,

Article / Optimal Congestion Control of TCP Flows in Intenet Routers

Proceedings of MAMA Workshop

K. Avrachenkov, U. Ayesta, J. Doncel, P. Jacko

Article / Optimal congestion control of TCP flows for internet routers

Performance Evaluation Review

Avrachenkov, K.; Ayesta, U.; Doncel, J.; Jacko, P.

2011

Article / Optimal Load Balancing in Processor Sharing Systems

Telecommunication Systems

Altman E., Ayesta U., Prabhu B.J.

Article / Properties of the Gittins index with application to optimal

Probability in the Engineering and Informational Sciences

S. Aalto, U. Ayesta, R. Righter

Article / Opportunistic scheduling in wireless systems: stability and asymptotic optimality

U. Ayesta, M. Erausquin, M. Jonckheere, I.M. Verloop

Article / Heavy-Traffic analysis of discriminatory random order of service

Performance Evaluation Review

U. Ayesta, A. Izagirre, I.M. Verloop

Article / Price of anarchy in non-cooperative load balancing games

Performance Evaluation

Ayesta, U.; Brun, O.; Prabhu, B.J.

Article / Heavy-traffic analysis of a multiple-phase network with discriminatory processor sharing

Operations Research

Verloop, I.M.; Ayesta, U.; Núñez-Queija, R.

Article / Properties of the gittins index with application to optimal scheduling

Probability in the Engineering and Informational Sciences

Aalto, S.; Ayesta, U.; Righter, R.

2010

Chapter / Modern Trends in Controlled Stochastic Processes: Theory and Applications

A.P. Piunovskiy

K. Avrachenkov, U. Ayesta, N. Osipova

Article / Price of Anarchy in Non-Cooperative Server-Farms

Proceedings of IEEE INFOCOM 2010

U. Ayesta, O. Brun, B.J. Prabhu

Article / Early Retransmit for TCP and SCTP

Requests For Comments (RFC) 5827

M. Allman, K. Avrachenkov, U. Ayesta, J. Blanton, P. Hurtig

Article / Convergence of trajectories and optimal buffer sizing for AIMD congestion control

Performance Evaluation

Avrachenkov, K.; Ayesta, U.; Piunovskiy, A.

2009

Article / Heavy-traffic analysis of the M/PH/1 discriminatory processor sharing queue with phase-dependent weights

Performance Evaluation Review

Verloop I.M., Ayesta U., Nunez-Queija R.

Article / On the Gittins index in the M/G/1 queue

Queueing Systems

Aalto, S.; Ayesta, U.; Righter, R.

2008

Chapter / Telecommunications Modeling, Policy and Technology

S. Raghavan, B. Golden and E. Wasil

Ayesta U., Piunovskiy A., Zhang Y.

Article / Recent sojourn time result for multi-level processor sharing scheduling policies

Statistica Neerlandica

Aalto S., Ayesta U.

2025

Conference Paper | Deep Reinforcement Learning for Weakly Coupled MDP’s with Continuous Actions

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) - Conference Paper

Robledo, F.; Ayesta, U.; Avrachenkov, K.

2024

Conference paper | Deep reinforcement learning for weakly coupled MDP's with continuous actions

F. Robledo, U. Ayesta, K. Avrachenkov

2021

Conference Paper | Improving the Performance of Heterogeneous Data Centers through Redundancy

Performance Evaluation Review - Conference Paper

Anton, E.; Ayesta, U.; Jonckheere, M.; Verloop, I.M.

Conference Paper | Improving the Performance of Heterogeneous Data Centers through Redundancy

SIGMETRICS 2021 - Abstract Proceedings of the 2021 ACM SIGMETRICS / International Conference on Measurement and Modeling of Computer Systems - Conference Paper

Anton, E.; Ayesta, U.; Jonckheere, M.; Verloop, I.M.

2019

Conference Paper | Redundancy with processor sharing servers

Performance Evaluation Review - Conference Paper

Anton, E.; Ayesta, U.; Jonckheere, M.; Verloop, I.M.

Conference Paper | On the impact of mobility in cellular networks

Proceedings - 17th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks, WiOpt 2019 - Conference Paper

Anton, E.; Ayesta, U.; Simatos, F.

Conference Paper | On a unifying product form framework for redundancy models

Performance Evaluation Review - Conference Paper

Ayesta, U.; Bodas, T.; Verloop, I.M.

2018

Conference Paper | Special volume on selected papers from the second ECQT conference

Performance Evaluation - Conference Paper

Ayesta, U.; Prabhu, B.J.

2017

Conference Paper | Economies of scale in parallel-server systems

Proceedings - IEEE INFOCOM - Conference Paper

Doncel, J.; Aalto, S.; Ayesta, U.

2015

Conference Paper | Stochastic and fluid index policies for resource allocation problems

Proceedings - IEEE INFOCOM - Conference Paper

Larranaga, M.; Ayesta, U.; Verloop, I.M.

Conference Paper | Non-intrusive scheduling of TCP flows

Proceedings of 2015 14th IFIP Networking Conference, IFIP Networking 2015 - Conference Paper

Ayesta, U.; Bertaux, L.; Carvin, D.

2014

Conference Paper | Index policies for a multi-class queue with convex holding cost and abandonments

Performance Evaluation Review - Conference Paper

Larrañaga, M.; Ayesta, U.; Verloop, I.M.

Conference Paper | Sojourn time approximations in a multi-class time-sharing server

Proceedings - IEEE INFOCOM - Conference Paper

Izagirre, A.; Ayesta, U.; Verloop, I.M.

Conference Paper | Index policies for a multi-class queue with convex holding cost and abandonments

SIGMETRICS 2014 - Proceedings of the 2014 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems - Conference Paper

Larrañaga, M.; Ayesta, U.; Verloop, I.M.

2013

Conference Paper | On the efficiency of non-cooperative load balancing

2013 IFIP Networking Conference, IFIP Networking 2013 - Conference Paper

Doncel, J.; Ayesta, U.; Brun, O.; Prabhu, B.J.

2011

Conference Paper | Resource-sharing in a single server with time-varying capacity

2011 49th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2011 - Conference Paper

Ayesta, U.; Erausquin, M.; Jacko, P.

Conference Paper | Competition yields efficiency in load balancing games

Performance Evaluation - Conference Paper

Anselmi, J.; Ayesta, U.; Wierman, A.

Conference Paper | Heavy-traffic analysis of the discriminatory random-order-of-service discipline

Performance Evaluation Review - Conference Paper

Ayesta, U.; Izagirre, A.; Verloop, I.M.

Conference Paper | A nearly-optimal index rule for scheduling of users with abandonment

Proceedings - IEEE INFOCOM - Conference Paper

Ayesta, U.; Jacko, P.; Novak, V.

Conference Paper | Stability and asymptotic optimality of opportunistic schedulers in wireless systems

VALUETOOLS 2011 - 5th International ICST Conference on Performance Evaluation Methodologies and Tools - Conference Paper

Ayesta, U.; Erausquin, M.; Jonckheere, M.; Verloop, I.M.

2010

Conference Paper | A modeling framework for optimizing the flow-level scheduling with time-varying channels

Performance Evaluation - Conference Paper

Ayesta, U.; Erausquin, M.; Jacko, P.