Thursday, January 12, 2023

More Echo Chambers

Water Works

We should revisit the image of "echo chamber", which I think is a good one, yet even more powerful if paired with other words such as "groupthink" and "choir", even "silo".  I'd make a great machine learner, or am one already, as Chelsea Manning suggested in Berlin that time.

Yes, I've been exploring the world (planet) of NLP, natural language processing.  The specialists have carved out a nifty niche, with a smooth vocab, kudos to University of Toronto.  

When I tell the story, I let Regular Polytopes hitch a ride on the ML bandwagon, because Graph Theory, because Linear Algebra.  I'm linking Regular Polytopes to Coxeter of course, also University of Toronto, and practitioner of hyper-dimensional Euclidean language games.

Did you know Coxeter lent his suite at Cambridge to the Wittgenstein posse, even after deciding what passed for hot philo was not his cup of tea.  Ludwig (LW) had entered his "second phase" by then ("language games"), if I'm not mistaken.  My source is the Siobhan Roberts Donald Coxeter bio:  The King of Infinite Space.  She did a later bio of Conway.

I'm not the expert in the room when it comes to NLP.  I do rub up against Machine Learning in my contemporary role on faculty, but more the way a high school teacher rubs against higher math, as an admirer and fan.  I'll lurk in on Andrius talking Sheffer Polynomials and even get deeper into his slides, but I'm not venturing as an equal into the ring.  I'm an apprentice at best in so many arenas.

My understanding is a breakthrough in the concepts of Attention and Self Attention (operationally defined) has enabled "next word predictors" to take more context into account, in addition to word order.  Would it be right to say a weighted semantic network develops internally, connecting higher attention words to their most frequent associates?  "Michelin" goes with "guide" "travel" and "tourist" as well as "tire".

Speaking of tourism and travel, at one point I was told, while gazing over the maze-like pattern of walls and chambers in the Colosseum in Rome, that I was seeing the ruins of a medieval castle that occupied the Roman stadium in a later century.  I believed that, but was recently talked into accepting these walls and chambers date to Roman times, while the castle story is also true (they're not mutually exclusive). 

Actually, my family, mother in particular, knows more about that castle than most, having taken an interest in Jacopa Frangipani, a luminary protagonist in her The Lions and The Lamb, an historical fiction novel, unpublished.  The Frangipanis owned the castle.  Jacopa was a friend and admirer of St. Francis.

You may have picked up on what I'm doing here:  showing off what "real intelligence" (vs the phony stuff) is still capable of, in contrast.  Everything may appear strung together haphazardly, but on deeper digging, everything checks out.  Eat your heart out GPT-3.