The Wasteful Legacy of Programming as Language
A few years ago I visited a friend who is a graduate student in linguistics. After some time he asked me if I was aware of the work by Chomsky on formal languages. I told him that yes, Chomsky work was a basis for much of the developments in theoretical computer science. More than that, I was glad to learn that there was something technical that I could share and discuss with other people in linguistics.
At the time I found this was just a great coincidence. It was only recently, though, that I started to think seriously about the implications of the idea that much of our understanding of computer programming stated with the study of human languages.
Language and Computers
One of the early ambitions in computer science was to understand, or at least be able to parse, human language. In order to do this, computer scientists explored models of how language worked in general. Based on these models, researchers figured out that we could classify languages in terms of complexity. Moreover, many computer languages could be entirely contained in some of the lower levels of this hierarchy, which is called the Chomsky hierarchy.
This was an incredible discovery for scientists working on compilers and interpreters, because its developments resulted in the necessary tools to efficiently parse languages. After that, instead of creating ad hoc parsers, which was the norm in the early period, one could apply a rigorous method to find a parser for a particular programming language.
The insidious side of this success, however, is that it completely changed the perceptions computer scientists have of how to give instructions to computers. We now have a frame of mind in which the important thing in the process of instructing a computer is to define a suitable language – and the more powerful the language the better.
The problem of this line of reasoning is that it creates a number of hurdles that are completely artificial, as we will soon discuss. For example, it makes us believe that there is something fundamentally different between programming languages, when in fact it doesn’t.
Computer Languages versus Human Languages
When we look at human languages, it does make sense that different languages exist. After all, language is a cultural concept. For example, as a speaker of two languages, it is very clear to me that speaking in English conveys different meaning and context, compared to things spoken in my mother language. There are a set of ideas that are better expressed in English, as well as there is a huge subset of thoughts that I wouldn’t be able to express well in anything other than my primary language.
As human beings, we want language to be inexact and able to convey several meanings. Contrary to the popular belief among mathematicians and engineers, this is a good feature of human languages, because it mimics the way we think. The truth about the study of language is that we are dealing with the whole culture of a community, not just with a stream of tokens that convey meaning.
The opposite, however, is true for computer languages. While we might strongly favor the use of human-like language, computers don’t really care if we use a bracket of a “begin” symbol to start a block of commands. Which means that we are, by introducing the subtleties of human language, complicating the task of how to instruct computers. Instead, we could just avoid the subtle differences in programming language and use a simple, uniform representation.
Unnecessary Work
The other problem with using current programming languages is that they create a lot of unnecessary work. Computer scientists have throughout the years devised baroque languages such as C++ and Java in an effort to provide programming instructions in a powerful way. It turns out, however, that the whole steps of writing a sequence of tokens, parsing that stream, and checking the syntax is unnecessary.
Everything in a computer program can be interpreted as a tree of expressions. If you’re encoding that tree in a block generated by a bracketed expression or a for loop it is not important for the computer. There is no reason why we cannot manipulate the syntax tree directly, for example, using a tree model on the screen, instead of parsing tokens used to recreate the tree every single time.
As a result, the use of a language is unnecessary in both sides: computers don’t care where the stream of bits is coming from. It could be coming from a direct binary representation or from a Java program with all variables in German.
Human beings, on the other hand, don’t necessarily need to use the language either. Although it may look like a useful feature, the existence of a language implies the manual labor of keeping a textual representation, as well as the algorithmic work of translating that representation back into a tree of expressions. The point is that, for all we care, we could just as well be moving boxes around the screen to represent variables — there is no necessity to create a textual document representing a program.
Divide and Conquer
Still, the other issue with programming languages is that it tends to divide programmers into artificial categories, one for each language or even flavor of a language. For example the only difference between a Java programmer and a C# programmer is that they use somewhat different keywords and have to program against a different run time library. The only reason C# and Java programmers think of themselves as different is that they use the concept of language to define themselves.
Being more polemic, the only difference between a C programmer and a Lisp programmer is in what their languages force them to do. A C programmer is forced by its language to write pointer-related code. While a Lisp programmer is forced to think in terms of lists of expressions (even when they’re using other data structures).
A language-less programming system, on the other hand, would avoid this kind of issue altogether by providing only the means to do work, without forcing programmers to use a pre-defined way of thinking. Whatever the form used to interact with the program, a language-less system doesn’t care if parts of the program are shaped as s-expressions or C blocks: it just combine them as needed to create a program.
In a program written in this way, using garbage collection is just a matter of plugging the right run time support, which you could get along with the system or you could buy from a third party. Instead, we erroneously consider garbage collection as a fundamental attribute of the language in use. As another example, in a language agnostic system we would would be able to create and call closures by just adding a simple module to the system, not by devising yet another language that supports closures as a first class citizen.
But the advantages don’t stop there. Without the need for a language, it also disappears the need for a compiler. Everything is such a system is already parsed and ready to use. When we combine pieces of code they already know how to glue themselves to each other, so there is no need for a linker either.
A system would regenerate a new executable in a fraction of a second, instead of going through the painful and wasteful process of language interpretation, code generation, linking. For example, what exactly is the need to recompile an entire file when we change only a single character? In a traditional language, that is entirely necessary, because you could be modifying the token “blass” to “class”, which changes entirely the meaning of the whole file. In a language-less system, this could never happen, because each transformation is related to the existing syntax tree, which is already stored in the system. Therefore, a single change like this can only have local effect in the program.
Why Such a System Doesn’t Exist?
There are several reasons, but the least important of them is technology. We have graphical capabilities in any modern desktop computer that are beyond what is necessary to implement the visualization features for such a programming environment. The main difficulty separating us from that goal is the experience we already have as programmers.
Each one of us have been trained to use textual languages as the main way of interact with computers. We have learned to use associated tools, such as grep and make, that are imperfect but that give good results if you are disciplined.
Moreover, it is satisfying to use the huge amount of code available with the existing technologies. Everyone of us have been conditioned for many years to look at what has been done in our programming language, and even reuse the code if needed.
I think that this is the main reason why visual languages have had such a hard time to establish themselves. After using such a language for a few minutes, you immediately feel that it is so much easier to go back and write yet another program in C or Java or Python. Of course, it will always be much more productive to use a tool that you’re used to.
However, we have never been able to really improve a language-less system enough to see their advantages as compared to traditional language-based systems. I believe that there will be a big jump in programming quality the day a group of people decide to develop a true language-agnostic programming system. And when programmers in general learn that they don’t need a language to create valid code they will think that we were just crazy for using, for such a long time, a concept as wasteful as that of programming language.
Photo credit: commons.wikimedia.com
Fine material, Thank you.
Hello! This is kind of off topic but I need some help from an established
blog. Is it tough to set up your own blog? I’m not very techincal but I can figure things out pretty fast.
I’m thinking about setting up my own but I’m not sure
where to begin. Do you have any points or suggestions?
Appreciate it
What’s up to all, the contents present at this web page are in fact amazing
for people experience, well, keep up the good work fellows.
What’s up to every body, it’s my first pay a visit of this weblog;
this web site carries awesome and truly excellent
data for readers.
Right here is the right blog for anybody who really wants to find out about this
topic. You know a whole lot its almost hard to argue with you (not that I personally
would want to…HaHa). You definitely put a brand new spin on a subject that has been discussed for many years.
Excellent stuff, just wonderful!
Hi there to every single one, it’s truly a nice for me to go to see this web site,
it consists of important Information.
Thanks for the good writeup. It in fact was a amusement account it.
Glance complicated to more added agreeable from you! However, how could we keep up a correspondence?
Hello! Someone in my Facebook group shared this site with us so I came to look it over.
I’m definitely enjoying the information. I’m bookmarking
and will be tweeting this to my followers! Wonderful blog and wonderful
design.
After checking out a number of the articles on your web site, I really appreciate your way
of blogging. I book marked it to my bookmark website list and
will be checking back soon. Please visit my
website as well and let me know what you think.
Do you have a spam issue on this website; I also am a blogger, and I was wanting to know your situation; we
have created some nice practices and we are looking to swap techniques with other folks,
be sure to shoot me an e-mail if interested.
It’s a shame you don’t have a donate button! I’d certainly donate to this fantastic
blog! I guess for now i’ll settle for bookmarking and
adding your RSS feed to my Google account. I look forward to brand new
updates and will share this website with my Facebook group.
Talk soon!
I got this web page from my pal who informed me about this site and at the
moment this time I am visiting this site and reading very informative articles
or reviews at this time.
Great post.
Good day I am so happy I found your webpage, I really
found you by error, while I was looking on Askjeeve for something else, Nonetheless I
am here now and would just like to say thank you for a fantastic post and a all round
interesting blog (I also love the theme/design), I don’t have time to read through it
all at the minute but I have book-marked it and also
added in your RSS feeds, so when I have time I will be back to read much
more, Please do keep up the fantastic work.
We are a group of volunteers and opening a brand new scheme in our community.
Your website offered us with useful information to work on. You’ve performed an impressive job and our
whole community might be thankful to you.
Hi, I do think this is an excellent blog.
I stumbledupon it ;) I am going to return once again since I book-marked
it. Money and freedom is the best way to change, may you
be rich and continue to guide other people.
Thanks for sharing your thoughts about nimrod. Regards
You really make it seem so easy with your presentation but I find this matter
to be really something that I think I would never understand.
It seems too complicated and extremely broad
for me. I am looking forward for your next post, I will try to get the hang of it!
Hey! This is my first visit to your blog! We are a group of volunteers and starting a new project in a community in the same niche.
Your blog provided us valuable information to work on. You have done
a wonderful job!
Hello i am kavin, its my first occasion to
commenting anyplace, when i read this article i thought i could
also make comment due to this sensible piece of writing.
This is really interesting, You’re a very skilled blogger.
I have joined your rss feed and look forward to seeking more of your magnificent post.
Also, I have shared your website in my social networks!
Do you mind if I quote a couple of your posts as long as I provide credit and
sources back to your blog? My blog is in the very same niche as yours and my visitors would certainly benefit from a lot of the information you present here.
Please let me know if this alright with you. Thanks!
I like the helpful information you provide in your articles.
I’ll bookmark your weblog and check again here frequently.
I am quite certain I will learn many new stuff right here!
Best of luck for the next!
Hi, I do believe this is an excellent blog.
I stumbledupon it ;) I will return once again since i
have book-marked it. Money and freedom is the greatest way to change,
may you be rich and continue to guide others.
Thanks , I have just been searching for info approximately this subject for
ages and yours is the best I’ve discovered till now.
But, what concerning the conclusion? Are you positive concerning the source?
Hi are using WordPress for your site platform? I’m new to
the blog world but I’m trying to get started
and create my own. Do you need any html coding expertise to make your own blog?
Any help would be really appreciated!
Generally I don’t learn article on blogs, however I
wish to say that this write-up very pressured me to take a look at and do it!
Your writing taste has been amazed me. Thank you, very great post.
I was suggested this web site by my cousin. I’m not sure whether this post is written by him as no one else know such detailed about my problem.
You are incredible! Thanks!
I always spent my half an hour to read this weblog’s posts daily
along with a mug of coffee.
Excellent blog! Do you have any suggestions for aspiring writers?
I’m planning to start my own site soon but I’m a little lost on everything.
Would you suggest starting with a free platform like WordPress or go
for a paid option? There are so many options out there that I’m completely
confused .. Any tips? Thanks a lot!
Informative article, totally what I needed.
This is a topic which is close to my heart… Many thanks!
Exactly where are your contact details though?
I read this post fully about the comparison of hottest
and earlier technologies, it’s remarkable article.
I want to to thank you for this wonderful read!!
I absolutely enjoyed every little bit of it.
I’ve got you saved as a favorite to look at new
stuff you post…
This is a topic that is close to my heart… Many thanks!
Exactly where are your contact details though?
Thank you for the good writeup. It in fact was a amusement account it.
Look advanced to more added agreeable from you!
By the way, how could we communicate?
Hi there! This is kind of off topic but I need some guidance
from an established blog. Is it very difficult to set up your own blog?
I’m not very techincal but I can figure things out
pretty quick. I’m thinking about creating
my own but I’m not sure where to start. Do you have any ideas or suggestions?
Thanks
Hello, after reading this amazing article i am as well cheerful to share my familiarity here with colleagues.
Woah! I’m really digging the template/theme of this website.
It’s simple, yet effective. A lot of times it’s challenging to
get that “perfect balance” between usability and visual appeal.
I must say that you’ve done a superb job with this.
In addition, the blog loads extremely quick for me
on Opera. Excellent Blog!
My brother suggested I might like this website. He was entirely right.
This post truly made my day. You cann’t imagine just how much time I
had spent for this info! Thanks!
I was pretty pleased to uncover this website. I wanted to
thank you for ones time due to this fantastic read!! I definitely appreciated every part of it
and i also have you book-marked to look at new information on your blog.
I appreciate, cause I found just what I was looking for.
You have ended my four day long hunt! God Bless you man. Have a
great day. Bye
It’s amazing to visit this website and reading the views of all
friends regarding this post, while I am also keen of getting
familiarity.
I don’t even know how I ended up here, but I thought this post was great.
I do not know who you are but certainly you are going to
a famous blogger if you are not already ;) Cheers!
I was recommended this website by my cousin. I am not sure whether this post is written by him as nobody else know such detailed
about my difficulty. You’re amazing! Thanks!
Hi, after reading this remarkable piece of writing i am as well cheerful to share my experience
here with friends.
My brother recommended I would possibly like this web site.
He was once totally right. This publish actually made my day.
You can not believe simply how much time I had spent for
this information! Thank you!
I’m not that much of a online reader to be honest
but your sites really nice, keep it up! I’ll go
ahead and bookmark your website to come back down the
road. All the best
Howdy! This is my first visit to your blog! We are a group of volunteers and starting a new project in a community
in the same niche. Your blog provided us valuable information to work
on. You have done a wonderful job!
This information is invaluable. Where can I find out more?