pinboard November 8, 2019

  • Twitter
    RT @runasand: Today the @nytimes chose to eliminate my role, stating that there is no need for a dedicated focus on newsroom and…
  • [1910.13038] Learning to Predict Without Looking Ahead: World Models Without Forward Prediction

    Much of model-based reinforcement learning involves learning a model of an agent’s world, and training an agent to leverage this model to perform a task more efficiently. While these models are demonstrably useful for agents, every naturally occurring model of the world of which we are aware—e.g., a brain—arose as the byproduct of competing evolutionary pressures for survival, not minimization of a supervised forward-predictive loss via gradient descent. That useful models can arise out of the messy and slow optimization process of evolution suggests that forward-predictive modeling can arise as a side-effect of optimization under the right circumstances. Crucially, this optimization process need not explicitly be a forward-predictive loss. In this work, we introduce a modification to traditional reinforcement learning which we call observational dropout, whereby we limit the agents ability to observe the real environment at each timestep. In doing so, we can coerce an agent into learning a world model to fill in the observation gaps during reinforcement learning. We show that the emerged world model, while not explicitly trained to predict the future, can help the agent learn key skills required to perform well in its environment. Videos of our results available at this https URL

  • Finally giving up on the grass, Tashkent Park celebrated as international symbol of goodwill | CHS Capitol Hill Seattle
  • CRISPR technique tracks genetic activity in real time
  • Twitter
    RT @WajahatAli: In normal times this would be the leading news for weeks. We will forget by tonight.
  • What Matt Bevin’s 2019 Loss Doesn’t Mean for Donald Trump in 2020 – Rolling Stone

    As long as the president still has his cult of personality and is still selling white supremacy, and as long as domestic disenfranchisement is pairing with foreign election interference to silence American voters whom Republicans don’t like, Trump stands a great chance of being re-elected

  • Twitter
    RT @NigelDPresents: This needs to be a short play called "White Privilege."

Digest powered by RSS Digest