SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks

Martim Brandao, Kenji Hashimoto, Atsuo Takanishi

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    Trajectory optimization and posture generation are hard problems in robot locomotion, which can be nonconvex and have multiple local optima. Progress on these problems is further hindered by a lack of open benchmarks, since comparisons of different solutions are difficult to make. In this paper we introduce a new benchmark for trajectory optimization and posture generation of legged robots, using a pre-defined scenario, robot and constraints, as well as evaluation criteria. We evaluate state-of-The-Art trajectory optimization algorithms based on sequential quadratic programming (SQP) on the benchmark, as well as new stochastic and incremental optimization methods borrowed from the large-scale machine learning literature. Interestingly we show that some of these stochastic and incremental methods, which are based on stochastic gradient descent (SGD), achieve higher success rates than SQP on tough initializations. Inspired by this observation we also propose a new incremental variant of SQP which updates only a random subset of the costs and constraints at each iteration. The algorithm is the best performing in both success rate and convergence speed, improving over SQP by up to 30% in both criteria. The benchmark's resources and a solution evaluation script are made openly available.

    Original languageEnglish
    Title of host publication2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017
    PublisherIEEE Computer Society
    Pages39-46
    Number of pages8
    VolumePart F134101
    ISBN (Electronic)9781538646786
    DOIs
    Publication statusPublished - 2017 Dec 22
    Event17th IEEE-RAS International Conference on Humanoid Robotics, Humanoids 2017 - Birmingham, United Kingdom
    Duration: 2017 Nov 152017 Nov 17

    Other

    Other17th IEEE-RAS International Conference on Humanoid Robotics, Humanoids 2017
    CountryUnited Kingdom
    CityBirmingham
    Period17/11/1517/11/17

    Fingerprint

    Biped locomotion
    Quadratic programming
    Robots
    Trajectories
    Learning systems
    Costs

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Vision and Pattern Recognition
    • Hardware and Architecture
    • Human-Computer Interaction
    • Electrical and Electronic Engineering

    Cite this

    Brandao, M., Hashimoto, K., & Takanishi, A. (2017). SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks. In 2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017 (Vol. Part F134101, pp. 39-46). IEEE Computer Society. https://doi.org/10.1109/HUMANOIDS.2017.8239535

    SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks. / Brandao, Martim; Hashimoto, Kenji; Takanishi, Atsuo.

    2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017. Vol. Part F134101 IEEE Computer Society, 2017. p. 39-46.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Brandao, M, Hashimoto, K & Takanishi, A 2017, SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks. in 2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017. vol. Part F134101, IEEE Computer Society, pp. 39-46, 17th IEEE-RAS International Conference on Humanoid Robotics, Humanoids 2017, Birmingham, United Kingdom, 17/11/15. https://doi.org/10.1109/HUMANOIDS.2017.8239535
    Brandao M, Hashimoto K, Takanishi A. SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks. In 2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017. Vol. Part F134101. IEEE Computer Society. 2017. p. 39-46 https://doi.org/10.1109/HUMANOIDS.2017.8239535
    Brandao, Martim ; Hashimoto, Kenji ; Takanishi, Atsuo. / SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks. 2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017. Vol. Part F134101 IEEE Computer Society, 2017. pp. 39-46
    @inproceedings{857a78517dd441a08ba0a8d2c7539d71,
    title = "SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks",
    abstract = "Trajectory optimization and posture generation are hard problems in robot locomotion, which can be nonconvex and have multiple local optima. Progress on these problems is further hindered by a lack of open benchmarks, since comparisons of different solutions are difficult to make. In this paper we introduce a new benchmark for trajectory optimization and posture generation of legged robots, using a pre-defined scenario, robot and constraints, as well as evaluation criteria. We evaluate state-of-The-Art trajectory optimization algorithms based on sequential quadratic programming (SQP) on the benchmark, as well as new stochastic and incremental optimization methods borrowed from the large-scale machine learning literature. Interestingly we show that some of these stochastic and incremental methods, which are based on stochastic gradient descent (SGD), achieve higher success rates than SQP on tough initializations. Inspired by this observation we also propose a new incremental variant of SQP which updates only a random subset of the costs and constraints at each iteration. The algorithm is the best performing in both success rate and convergence speed, improving over SQP by up to 30{\%} in both criteria. The benchmark's resources and a solution evaluation script are made openly available.",
    author = "Martim Brandao and Kenji Hashimoto and Atsuo Takanishi",
    year = "2017",
    month = "12",
    day = "22",
    doi = "10.1109/HUMANOIDS.2017.8239535",
    language = "English",
    volume = "Part F134101",
    pages = "39--46",
    booktitle = "2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017",
    publisher = "IEEE Computer Society",

    }

    TY - GEN

    T1 - SGD for robot motion? the effectiveness of stochastic optimization on a new benchmark for biped locomotion tasks

    AU - Brandao, Martim

    AU - Hashimoto, Kenji

    AU - Takanishi, Atsuo

    PY - 2017/12/22

    Y1 - 2017/12/22

    N2 - Trajectory optimization and posture generation are hard problems in robot locomotion, which can be nonconvex and have multiple local optima. Progress on these problems is further hindered by a lack of open benchmarks, since comparisons of different solutions are difficult to make. In this paper we introduce a new benchmark for trajectory optimization and posture generation of legged robots, using a pre-defined scenario, robot and constraints, as well as evaluation criteria. We evaluate state-of-The-Art trajectory optimization algorithms based on sequential quadratic programming (SQP) on the benchmark, as well as new stochastic and incremental optimization methods borrowed from the large-scale machine learning literature. Interestingly we show that some of these stochastic and incremental methods, which are based on stochastic gradient descent (SGD), achieve higher success rates than SQP on tough initializations. Inspired by this observation we also propose a new incremental variant of SQP which updates only a random subset of the costs and constraints at each iteration. The algorithm is the best performing in both success rate and convergence speed, improving over SQP by up to 30% in both criteria. The benchmark's resources and a solution evaluation script are made openly available.

    AB - Trajectory optimization and posture generation are hard problems in robot locomotion, which can be nonconvex and have multiple local optima. Progress on these problems is further hindered by a lack of open benchmarks, since comparisons of different solutions are difficult to make. In this paper we introduce a new benchmark for trajectory optimization and posture generation of legged robots, using a pre-defined scenario, robot and constraints, as well as evaluation criteria. We evaluate state-of-The-Art trajectory optimization algorithms based on sequential quadratic programming (SQP) on the benchmark, as well as new stochastic and incremental optimization methods borrowed from the large-scale machine learning literature. Interestingly we show that some of these stochastic and incremental methods, which are based on stochastic gradient descent (SGD), achieve higher success rates than SQP on tough initializations. Inspired by this observation we also propose a new incremental variant of SQP which updates only a random subset of the costs and constraints at each iteration. The algorithm is the best performing in both success rate and convergence speed, improving over SQP by up to 30% in both criteria. The benchmark's resources and a solution evaluation script are made openly available.

    UR - http://www.scopus.com/inward/record.url?scp=85044436842&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85044436842&partnerID=8YFLogxK

    U2 - 10.1109/HUMANOIDS.2017.8239535

    DO - 10.1109/HUMANOIDS.2017.8239535

    M3 - Conference contribution

    VL - Part F134101

    SP - 39

    EP - 46

    BT - 2017 IEEE-RAS 17th International Conference on Humanoid Robotics, Humanoids 2017

    PB - IEEE Computer Society

    ER -