- [2002.12327] A Primer in BERTology: What we know about how BERT works
Transformer-based models are now widely used in NLP, but we still do not understand a lot about their inner workings. This paper describes what is known to date about the famous BERT model (Devlin et al. 2019), synthesizing over 40 analysis studies. We also provide an overview of the proposed modifications to the model and its training regime. We then outline the directions for further research.
- Coronavirus COVID-19 (2019-nCoV)
- BabelColour 🎞 on Twitter: "I originally tweeted this last year, but it is so stunning I’m sharing it again. It is Dickensian London, photographed from Southwark Bridge 162 years ago and shows the majesty of St Paul’s Cathedral dominating London’s skyli
- Scientists accidentally discover first animal that doesn’t need oxygen to survive
- Piled Bodies, Overflowing Morgues: Inside America’s Autopsy Crisis – The New York Times
- Twitter
RT @chrislhayes: So here’s what appears to be chain of events:
The Trump administration repatriated infected Americans over the obj…
- Twitter
RT @katecrawford: And here it is – the leaked client list of Clearview. Remember how they said it was “strictly law enforcement onlyâ€â€¦
- Twitter
RT @CBSNews: ODDLY SATISFYING: Team of vets pull AN ENTIRE BEACH TOWEL out of a python in Australia – with their bare hands.
- Twitter
RT @ahmetb: I might have implemented Kubernetes-style DNS Service Discovery in “Cloud Runâ€, and it seems to be working. 🙈
If y…
- Twitter
RT @jeremyphoward: In our book we always show code equivalents for any math notation.
So often, the Python & @PyTorch code is clearer…
- Twitter
RT @RonaldKlain: I was the WH Ebola Response Coordinator in 2014-15. We never told @CDCgov or @NIH what they could say, or ever cen…
- Untitled (https://www.nytimes.com/2020/02/27/us/politics/us-coronavirus-pence.html)
RT @HelenBranswell: 😯😯😯😯😯😯😯
- Twitter
RT @HelenBranswell: 😯😯😯😯😯😯😯
- Twitter
RT @jfruh: haha remember when that doctor in wuhan got in trouble for "spreading rumors" about coronavirus and everyone was li…
- Twitter
RT @Technobiologist: My grad degree in Microbiology & Immunology wanted me to retweet this. Immunity at the population level requires bo…
- Preparing for Coronavirus to Strike the U.S. – Scientific American Blog Network
- Twitter
RT @AdamSerwer: Epidemics are one reason you want a meritocratic, apolitical civil service staffing your government, instead of a b…
- Twitter
RT @Sifill_LDF: Are you seeing this? Denaturalization. A nightmare. And do not think they will stop just with naturalized citizens.…
- Meet Tot – Your Tiny Text Companion! • The Breakroom
- Tot • Your tiny text companion
- Twitter
RT @tomtomorrow: What America now gets to learn the hard way is that universal health care is not free stuff for other people, it’s…
- Twitter
RT @McMurtrieSF: Next week’s @NewYorker cover: an instant classic
- Deepnote Sets Course to Become the Jupyter Killer – Towards Data Science
DeepNote, a small team based out of San Fransisco, wants to take the place of Jupyter in your data science workflows. I think they just might do it.
- Twitter
RT @chrislhayes: When someone at HHS raised alarms about all this s/he was criticized for hurting morale and then ordered to another…
- Twitter
RT @chrislhayes: Then those workers went out into the public with no monitoring or testing regime in place.
And now the first US-co…
- Twitter
RT @polotek: The evil of white supremacy is happening right now. It doesn’t look like what you imagined in history. This is it.…
- Twitter
RT @owillis: i used to think "she’s duplicitous and conniving" was just a thing people said about hillary clinton because she is…
- 2019 coronavirus: The Korean clusters
- Twitter
RT @JaneMayerNYer: Trump touted Pence’s health record in Indiana but as Governor, Pence opposed needle exchanges as H.I.V. Cases spike…
Digest powered by RSS Digest