The Wasteful Legacy of Programming as Language
A few years ago I visited a friend who is a graduate student in linguistics. After some time he asked me if I was aware of the work by Chomsky on formal languages. I told him that yes, Chomsky work was a basis for much of the developments in theoretical computer science. More than that, I was glad to learn that there was something technical that I could share and discuss with other people in linguistics.
At the time I found this was just a great coincidence. It was only recently, though, that I started to think seriously about the implications of the idea that much of our understanding of computer programming stated with the study of human languages.
Language and Computers
One of the early ambitions in computer science was to understand, or at least be able to parse, human language. In order to do this, computer scientists explored models of how language worked in general. Based on these models, researchers figured out that we could classify languages in terms of complexity. Moreover, many computer languages could be entirely contained in some of the lower levels of this hierarchy, which is called the Chomsky hierarchy.
This was an incredible discovery for scientists working on compilers and interpreters, because its developments resulted in the necessary tools to efficiently parse languages. After that, instead of creating ad hoc parsers, which was the norm in the early period, one could apply a rigorous method to find a parser for a particular programming language.
The insidious side of this success, however, is that it completely changed the perceptions computer scientists have of how to give instructions to computers. We now have a frame of mind in which the important thing in the process of instructing a computer is to define a suitable language – and the more powerful the language the better.
The problem of this line of reasoning is that it creates a number of hurdles that are completely artificial, as we will soon discuss. For example, it makes us believe that there is something fundamentally different between programming languages, when in fact it doesn’t.
Computer Languages versus Human Languages
When we look at human languages, it does make sense that different languages exist. After all, language is a cultural concept. For example, as a speaker of two languages, it is very clear to me that speaking in English conveys different meaning and context, compared to things spoken in my mother language. There are a set of ideas that are better expressed in English, as well as there is a huge subset of thoughts that I wouldn’t be able to express well in anything other than my primary language.
As human beings, we want language to be inexact and able to convey several meanings. Contrary to the popular belief among mathematicians and engineers, this is a good feature of human languages, because it mimics the way we think. The truth about the study of language is that we are dealing with the whole culture of a community, not just with a stream of tokens that convey meaning.
The opposite, however, is true for computer languages. While we might strongly favor the use of human-like language, computers don’t really care if we use a bracket of a “begin” symbol to start a block of commands. Which means that we are, by introducing the subtleties of human language, complicating the task of how to instruct computers. Instead, we could just avoid the subtle differences in programming language and use a simple, uniform representation.
Unnecessary Work
The other problem with using current programming languages is that they create a lot of unnecessary work. Computer scientists have throughout the years devised baroque languages such as C++ and Java in an effort to provide programming instructions in a powerful way. It turns out, however, that the whole steps of writing a sequence of tokens, parsing that stream, and checking the syntax is unnecessary.
Everything in a computer program can be interpreted as a tree of expressions. If you’re encoding that tree in a block generated by a bracketed expression or a for loop it is not important for the computer. There is no reason why we cannot manipulate the syntax tree directly, for example, using a tree model on the screen, instead of parsing tokens used to recreate the tree every single time.
As a result, the use of a language is unnecessary in both sides: computers don’t care where the stream of bits is coming from. It could be coming from a direct binary representation or from a Java program with all variables in German.
Human beings, on the other hand, don’t necessarily need to use the language either. Although it may look like a useful feature, the existence of a language implies the manual labor of keeping a textual representation, as well as the algorithmic work of translating that representation back into a tree of expressions. The point is that, for all we care, we could just as well be moving boxes around the screen to represent variables — there is no necessity to create a textual document representing a program.
Divide and Conquer
Still, the other issue with programming languages is that it tends to divide programmers into artificial categories, one for each language or even flavor of a language. For example the only difference between a Java programmer and a C# programmer is that they use somewhat different keywords and have to program against a different run time library. The only reason C# and Java programmers think of themselves as different is that they use the concept of language to define themselves.
Being more polemic, the only difference between a C programmer and a Lisp programmer is in what their languages force them to do. A C programmer is forced by its language to write pointer-related code. While a Lisp programmer is forced to think in terms of lists of expressions (even when they’re using other data structures).
A language-less programming system, on the other hand, would avoid this kind of issue altogether by providing only the means to do work, without forcing programmers to use a pre-defined way of thinking. Whatever the form used to interact with the program, a language-less system doesn’t care if parts of the program are shaped as s-expressions or C blocks: it just combine them as needed to create a program.
In a program written in this way, using garbage collection is just a matter of plugging the right run time support, which you could get along with the system or you could buy from a third party. Instead, we erroneously consider garbage collection as a fundamental attribute of the language in use. As another example, in a language agnostic system we would would be able to create and call closures by just adding a simple module to the system, not by devising yet another language that supports closures as a first class citizen.
But the advantages don’t stop there. Without the need for a language, it also disappears the need for a compiler. Everything is such a system is already parsed and ready to use. When we combine pieces of code they already know how to glue themselves to each other, so there is no need for a linker either.
A system would regenerate a new executable in a fraction of a second, instead of going through the painful and wasteful process of language interpretation, code generation, linking. For example, what exactly is the need to recompile an entire file when we change only a single character? In a traditional language, that is entirely necessary, because you could be modifying the token “blass” to “class”, which changes entirely the meaning of the whole file. In a language-less system, this could never happen, because each transformation is related to the existing syntax tree, which is already stored in the system. Therefore, a single change like this can only have local effect in the program.
Why Such a System Doesn’t Exist?
There are several reasons, but the least important of them is technology. We have graphical capabilities in any modern desktop computer that are beyond what is necessary to implement the visualization features for such a programming environment. The main difficulty separating us from that goal is the experience we already have as programmers.
Each one of us have been trained to use textual languages as the main way of interact with computers. We have learned to use associated tools, such as grep and make, that are imperfect but that give good results if you are disciplined.
Moreover, it is satisfying to use the huge amount of code available with the existing technologies. Everyone of us have been conditioned for many years to look at what has been done in our programming language, and even reuse the code if needed.
I think that this is the main reason why visual languages have had such a hard time to establish themselves. After using such a language for a few minutes, you immediately feel that it is so much easier to go back and write yet another program in C or Java or Python. Of course, it will always be much more productive to use a tool that you’re used to.
However, we have never been able to really improve a language-less system enough to see their advantages as compared to traditional language-based systems. I believe that there will be a big jump in programming quality the day a group of people decide to develop a true language-agnostic programming system. And when programmers in general learn that they don’t need a language to create valid code they will think that we were just crazy for using, for such a long time, a concept as wasteful as that of programming language.
Photo credit: commons.wikimedia.com
I wanted to thank you for this wonderful read!!
I certainly loved every bit of it. I have you book-marked
to look at new things you post…
Hello! This is my 1st comment here so I just wanted to give a quick shout
out and say I truly enjoy reading your posts. Can you recommend any other blogs/websites/forums that go over the
same topics? Thank you!
I couldn’t refrain from commenting. Perfectly written!
Hello, i think that i saw you visited my blog thus i came
to “return the favor”.I am trying to find things to enhance my website!I suppose its ok to use a few of your ideas!!
Hi there I am so thrilled I found your blog page, I really found you by accident,
while I was searching on Askjeeve for something else, Regardless I am here now and would just like to say many thanks for a
tremendous post and a all round thrilling blog (I also
love the theme/design), I don’t have time to browse
it all at the moment but I have saved it and also added your RSS
feeds, so when I have time I will be back to read much more, Please do
keep up the awesome job.
Hey very interesting blog!
I do consider all of the ideas you have introduced in your
post. They’re really convincing and can certainly work.
Nonetheless, the posts are very quick for beginners. May just you
please lengthen them a little from next time?
Thank you for the post.
What a data of un-ambiguity and preserveness of precious knowledge regarding unexpected feelings.
Thank you for the good writeup. It in fact was a amusement account
it. Look advanced to more added agreeable from
you! However, how can we communicate?
I loved as much as you’ll receive carried out right here.
The sketch is tasteful, your authored material stylish.
nonetheless, you command get got an nervousness over that you wish be delivering the following.
unwell unquestionably come more formerly again since exactly the same nearly very often inside case you shield this increase.
Great post. I’m experiencing many of these issues as well..
I was very pleased to uncover this web site.
I need to to thank you for your time due to this wonderful read!!
I definitely savored every bit of it and i also have
you bookmarked to look at new stuff in your web site.
This is the right webpage for everyone who would like to find out about this topic.
You know a whole lot its almost hard to argue with
you (not that I personally would want to…HaHa).
You definitely put a brand new spin on a topic which has been discussed for
ages. Excellent stuff, just wonderful!
I was wondering if you ever thought of changing the structure of your website?
Its very well written; I love what youve got to say.
But maybe you could a little more in the way of content so people could connect with it better.
Youve got an awful lot of text for only having 1 or two pictures.
Maybe you could space it out better?
Hi there! Quick question that’s completely off topic.
Do you know how to make your site mobile friendly?
My weblog looks weird when viewing from my iphone4.
I’m trying to find a theme or plugin that might be able to resolve this issue.
If you have any suggestions, please share. Thanks!
you’re really a excellent webmaster. The website
loading velocity is incredible. It kind of feels that
you’re doing any distinctive trick. Moreover, The contents are masterwork.
you’ve done a fantastic task on this subject!
You really make it seem so easy with your presentation however I
to find this matter to be really one thing that I believe I might never understand.
It kind of feels too complicated and very wide
for me. I am looking ahead on your next put up, I will attempt to get the
dangle of it!
This article presents clear idea in favor of the new users
of blogging, that truly how to do blogging and site-building.
I am regular reader, how are you everybody? This post posted at this website is
truly good.
I feel that is one of the so much vital info for me. And i
am happy reading your article. But wanna remark on some general things, The website style is perfect, the articles is in point
of fact excellent : D. Just right job, cheers
An impressive share! I have just forwarded this onto a coworker who has been conducting a little homework on this.
And he in fact ordered me dinner because I discovered
it for him… lol. So allow me to reword this…. Thank YOU for
the meal!! But yeah, thanks for spending time to discuss this matter here on your site.
Way cool! Some very valid points! I appreciate you writing this article plus the rest
of the website is also very good.
Nice post. I was checking constantly this blog and I’m inspired!
Extremely helpful info particularly the remaining
section :) I maintain such info a lot. I used to be
looking for this certain info for a very lengthy time.
Thanks and best of luck.
Hi there to every one, it’s actually a fastidious for me to
go to see this website, it includes important Information.
Howdy this is somewhat of off topic but I was wanting to know if blogs use WYSIWYG editors or if
you have to manually code with HTML. I’m starting a blog soon but have no coding skills so I wanted to get advice
from someone with experience. Any help would be enormously appreciated!
I was able to find good advice from your content.
Currently it looks like Drupal is the top blogging platform available right
now. (from what I’ve read) Is that what you’re using on your blog?
Thanks for ones marvelous posting! I truly enjoyed reading it, you could be a great author.I will be sure to
bookmark your blog and may come back very soon. I want to encourage continue your great job,
have a nice weekend!
I do believe all of the concepts you’ve introduced on your post.
They’re really convincing and will certainly work. Still, the posts are too brief
for beginners. May just you please prolong them a little from subsequent time?
Thanks for the post.
Wow, fantastic weblog structure! How long have you ever been running a
blog for? you make blogging glance easy. The full look of your site is great, as neatly as the
content!
Howdy! I understand this is sort of off-topic however I needed
to ask. Does managing a well-established blog such as yours require a
massive amount work? I am completely new to blogging but I do write in my journal daily.
I’d like to start a blog so I can easily share my own experience and feelings online.
Please let me know if you have any suggestions or tips for brand new aspiring
bloggers. Appreciate it!
This blog was… how do you say it? Relevant!! Finally I’ve found something that helped
me. Appreciate it!
Your style is unique in comparison to other folks I’ve
read stuff from. Many thanks for posting when you’ve got the opportunity, Guess I’ll
just bookmark this blog.
I’m curious to find out what blog platform you’re working with?
I’m experiencing some small security problems with my latest blog
and I would like to find something more safeguarded.
Do you have any recommendations?
If you would like to obtain a good deal from this piece of writing then you have to apply these methods to your won weblog.
I have read so many posts concerning the blogger lovers but this article is actually a
nice article, keep it up.
Hello There. I found your blog using msn. This is a really
well written article. I’ll make sure to bookmark it and come back to read more of your useful information. Thanks
for the post. I will definitely comeback.
Greetings! This is my 1st comment here so I just wanted to give a
quick shout out and tell you I truly enjoy reading
your blog posts. Can you recommend any other blogs/websites/forums that cover the same subjects?
Thank you so much!
Fantastic blog! Do you have any suggestions for aspiring writers?
I’m hoping to start my own website soon but I’m a little lost on everything.
Would you recommend starting with a free platform like WordPress or
go for a paid option? There are so many choices out there that I’m totally confused ..
Any recommendations? Many thanks!
Seriously a good deal of good knowledge.
You made your stand quite well..
Awesome posts, Many thanks!
You made your point extremely clearly.!
Valuable facts With thanks!
Normally I don’t learn article on blogs, however I wish to say
that this write-up very forced me to check out and
do so! Your writing taste has been surprised me. Thanks, very nice article.
Excellent goods from you, man. I’ve understand your stuff previous to and you’re just too great.
I actually like what you’ve acquired here, certainly like what
you’re stating and the way in which you say it.
You make it entertaining and you still take care of to keep it wise.
I cant wait to read much more from you. This is actually
a great site.
Superb post however I was wanting to know if you could
write a litte more on this topic? I’d be very grateful if you could
elaborate a little bit more. Many thanks!
Many thanks, Useful information.
Quality articles is the main to attract the users
to go to see the site, that’s what this site is providing.
What’s up friends, its great article on the topic of teachingand
entirely defined, keep it up all the time.