The Wasteful Legacy of Programming as Language
A few years ago I visited a friend who is a graduate student in linguistics. After some time he asked me if I was aware of the work by Chomsky on formal languages. I told him that yes, Chomsky work was a basis for much of the developments in theoretical computer science. More than that, I was glad to learn that there was something technical that I could share and discuss with other people in linguistics.
At the time I found this was just a great coincidence. It was only recently, though, that I started to think seriously about the implications of the idea that much of our understanding of computer programming stated with the study of human languages.
Language and Computers
One of the early ambitions in computer science was to understand, or at least be able to parse, human language. In order to do this, computer scientists explored models of how language worked in general. Based on these models, researchers figured out that we could classify languages in terms of complexity. Moreover, many computer languages could be entirely contained in some of the lower levels of this hierarchy, which is called the Chomsky hierarchy.
This was an incredible discovery for scientists working on compilers and interpreters, because its developments resulted in the necessary tools to efficiently parse languages. After that, instead of creating ad hoc parsers, which was the norm in the early period, one could apply a rigorous method to find a parser for a particular programming language.
The insidious side of this success, however, is that it completely changed the perceptions computer scientists have of how to give instructions to computers. We now have a frame of mind in which the important thing in the process of instructing a computer is to define a suitable language – and the more powerful the language the better.
The problem of this line of reasoning is that it creates a number of hurdles that are completely artificial, as we will soon discuss. For example, it makes us believe that there is something fundamentally different between programming languages, when in fact it doesn’t.
Computer Languages versus Human Languages
When we look at human languages, it does make sense that different languages exist. After all, language is a cultural concept. For example, as a speaker of two languages, it is very clear to me that speaking in English conveys different meaning and context, compared to things spoken in my mother language. There are a set of ideas that are better expressed in English, as well as there is a huge subset of thoughts that I wouldn’t be able to express well in anything other than my primary language.
As human beings, we want language to be inexact and able to convey several meanings. Contrary to the popular belief among mathematicians and engineers, this is a good feature of human languages, because it mimics the way we think. The truth about the study of language is that we are dealing with the whole culture of a community, not just with a stream of tokens that convey meaning.
The opposite, however, is true for computer languages. While we might strongly favor the use of human-like language, computers don’t really care if we use a bracket of a “begin” symbol to start a block of commands. Which means that we are, by introducing the subtleties of human language, complicating the task of how to instruct computers. Instead, we could just avoid the subtle differences in programming language and use a simple, uniform representation.
Unnecessary Work
The other problem with using current programming languages is that they create a lot of unnecessary work. Computer scientists have throughout the years devised baroque languages such as C++ and Java in an effort to provide programming instructions in a powerful way. It turns out, however, that the whole steps of writing a sequence of tokens, parsing that stream, and checking the syntax is unnecessary.
Everything in a computer program can be interpreted as a tree of expressions. If you’re encoding that tree in a block generated by a bracketed expression or a for loop it is not important for the computer. There is no reason why we cannot manipulate the syntax tree directly, for example, using a tree model on the screen, instead of parsing tokens used to recreate the tree every single time.
As a result, the use of a language is unnecessary in both sides: computers don’t care where the stream of bits is coming from. It could be coming from a direct binary representation or from a Java program with all variables in German.
Human beings, on the other hand, don’t necessarily need to use the language either. Although it may look like a useful feature, the existence of a language implies the manual labor of keeping a textual representation, as well as the algorithmic work of translating that representation back into a tree of expressions. The point is that, for all we care, we could just as well be moving boxes around the screen to represent variables — there is no necessity to create a textual document representing a program.
Divide and Conquer
Still, the other issue with programming languages is that it tends to divide programmers into artificial categories, one for each language or even flavor of a language. For example the only difference between a Java programmer and a C# programmer is that they use somewhat different keywords and have to program against a different run time library. The only reason C# and Java programmers think of themselves as different is that they use the concept of language to define themselves.
Being more polemic, the only difference between a C programmer and a Lisp programmer is in what their languages force them to do. A C programmer is forced by its language to write pointer-related code. While a Lisp programmer is forced to think in terms of lists of expressions (even when they’re using other data structures).
A language-less programming system, on the other hand, would avoid this kind of issue altogether by providing only the means to do work, without forcing programmers to use a pre-defined way of thinking. Whatever the form used to interact with the program, a language-less system doesn’t care if parts of the program are shaped as s-expressions or C blocks: it just combine them as needed to create a program.
In a program written in this way, using garbage collection is just a matter of plugging the right run time support, which you could get along with the system or you could buy from a third party. Instead, we erroneously consider garbage collection as a fundamental attribute of the language in use. As another example, in a language agnostic system we would would be able to create and call closures by just adding a simple module to the system, not by devising yet another language that supports closures as a first class citizen.
But the advantages don’t stop there. Without the need for a language, it also disappears the need for a compiler. Everything is such a system is already parsed and ready to use. When we combine pieces of code they already know how to glue themselves to each other, so there is no need for a linker either.
A system would regenerate a new executable in a fraction of a second, instead of going through the painful and wasteful process of language interpretation, code generation, linking. For example, what exactly is the need to recompile an entire file when we change only a single character? In a traditional language, that is entirely necessary, because you could be modifying the token “blass” to “class”, which changes entirely the meaning of the whole file. In a language-less system, this could never happen, because each transformation is related to the existing syntax tree, which is already stored in the system. Therefore, a single change like this can only have local effect in the program.
Why Such a System Doesn’t Exist?
There are several reasons, but the least important of them is technology. We have graphical capabilities in any modern desktop computer that are beyond what is necessary to implement the visualization features for such a programming environment. The main difficulty separating us from that goal is the experience we already have as programmers.
Each one of us have been trained to use textual languages as the main way of interact with computers. We have learned to use associated tools, such as grep and make, that are imperfect but that give good results if you are disciplined.
Moreover, it is satisfying to use the huge amount of code available with the existing technologies. Everyone of us have been conditioned for many years to look at what has been done in our programming language, and even reuse the code if needed.
I think that this is the main reason why visual languages have had such a hard time to establish themselves. After using such a language for a few minutes, you immediately feel that it is so much easier to go back and write yet another program in C or Java or Python. Of course, it will always be much more productive to use a tool that you’re used to.
However, we have never been able to really improve a language-less system enough to see their advantages as compared to traditional language-based systems. I believe that there will be a big jump in programming quality the day a group of people decide to develop a true language-agnostic programming system. And when programmers in general learn that they don’t need a language to create valid code they will think that we were just crazy for using, for such a long time, a concept as wasteful as that of programming language.
Photo credit: commons.wikimedia.com
Do you mind if I quote a few of your posts as
long as I provide credit and sources back
to your website? My blog is in the very same area
of interest as yours and my visitors would truly benefit
from some of the information you provide here. Please let me know if
this ok with you. Thanks a lot!
It’s very easy to find out any matter on web as compared to
books, as I found this piece of writing at this website.
Thanks to my father who informed me on the topic of this webpage,
this web site is really amazing.
Oh my goodness! Awesome article dude! Thanks, However I am experiencing issues
with your RSS. I don’t know the reason why I cannot subscribe
to it. Is there anybody else getting similar RSS issues?
Anyone that knows the solution will you kindly respond? Thanks!!
My partner and I stumbled over here by a different web page and thought
I might check things out. I like what I see so now i’m following you.
Look forward to going over your web page for a second time.
When I originally commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get several emails with the same comment.
Is there any way you can remove me from that service?
Thanks!
Awesome post.
you’re truly a good webmaster. The website loading velocity is incredible.
It seems that you are doing any unique trick. Furthermore,
The contents are masterwork. you have done a excellent task in this subject!
Howdy! I just wish to offer you a huge thumbs up for the great info
you have got here on this post. I am coming back to your website for more soon.
I have read so many articles concerning the blogger lovers but this paragraph is actually a pleasant post, keep it
up.
Admiring the persistence you put into your site and in depth information you
present. It’s awesome to come across a blog every
once in a while that isn’t the same unwanted rehashed information. Fantastic read!
I’ve bookmarked your site and I’m adding your RSS feeds to my Google account.
Attractive section of content. I just stumbled upon your site and in accession capital to assert that
I acquire in fact enjoyed account your blog posts. Any
way I will be subscribing to your augment and even I achievement you access consistently rapidly.
Generally I do not learn post on blogs, but I wish to say that this write-up very
compelled me to check out and do it! Your writing style has been amazed me.
Thanks, very nice post.
What’s up, I would like to subscribe for this blog
to take newest updates, therefore where can i do it please help out.
You actually make it seem so easy with your presentation but I find this matter to be actually something
which I think I would never understand. It seems too complex
and extremely broad for me. I’m looking forward for your next post, I’ll try to get
the hang of it!
Since the admin of this website is working, no question very shortly it
will be well-known, due to its feature contents.
I’m truly enjoying the design and layout of your website. It’s a very easy on the
eyes which makes it much more enjoyable for me to come here and visit more often. Did you hire out a developer to create your theme?
Superb work!
I have read a few good stuff here. Definitely value bookmarking for revisiting.
I wonder how so much effort you place to create this sort of magnificent informative web site.
Thank you for sharing your thoughts. I really appreciate your efforts and I am waiting for your next write
ups thank you once again.
Have you ever considered publishing an e-book or guest authoring on other websites?
I have a blog centered on the same subjects you discuss and
would love to have you share some stories/information.
I know my subscribers would value your work. If you are even remotely interested,
feel free to shoot me an e-mail.
Yes! Finally someone writes about Window Refurbishment London.
This is a topic that is close to my heart… Take care!
Exactly where are your contact details though?
Asking questions are in fact fastidious thing
if you are not understanding something completely, however this paragraph gives good understanding yet.
We are a group of volunteers and opening a brand new scheme in our community.
Your site offered us with helpful info to work on. You’ve done an impressive
process and our whole neighborhood shall be grateful to you.
Greetings from Ohio! I’m bored at work so I decided to check out your
website on my iphone during lunch break. I enjoy the knowledge you present here and can’t
wait to take a look when I get home. I’m shocked at how fast your blog loaded on my phone
.. I’m not even using WIFI, just 3G .. Anyhow, wonderful site!
I think the admin of this web page is in fact working hard for his
web site, because here every data is quality based material.
Awesome! Its in fact awesome paragraph, I have got much clear idea concerning from this post.
Hi, I wish for to subscribe for this web site to get
latest updates, so where can i do it please assist.
Because the admin of this site is working, no uncertainty very quickly it will be renowned, due to its feature contents.
I am truly delighted to read this blog posts which includes tons of
helpful data, thanks for providing such information.
Wow, fantastic blog layout! How long have
you been blogging for? you make blogging look easy.
The overall look of your website is wonderful, let alone the content!
Hello there! Do you know if they make any plugins to
help with Search Engine Optimization? I’m trying to get my blog to rank for some
targeted keywords but I’m not seeing very good results.
If you know of any please share. Thank you!
This is a topic which is close to my heart… Best wishes!
Where are your contact details though?
Hello there, You’ve done an incredible job. I will definitely digg
it and personally recommend to my friends.
I’m sure they will be benefited from this website.
I really love your website.. Pleasant colors & theme.
Did you build this site yourself? Please reply back as I’m planning to create my own personal blog and
want to know where you got this from or exactly what the theme is named.
Many thanks!
I think the admin of this web page is really working hard for his
site, as here every material is quality based information.
Hello, just wanted to say, I enjoyed this article.
It was helpful. Keep on posting!
What’s Taking place i am new to this, I stumbled upon this I have
discovered It absolutely useful and it has helped me out loads.
I’m hoping to contribute & help different users like its aided me.
Great job.
It’s perfect time to make some plans for the future and it’s time to be happy.
I’ve read this post and if I could I wish to suggest you some interesting things or tips.
Maybe you can write next articles referring to this
article. I desire to read more things about it!
What you wrote was very reasonable. However, what about this?
suppose you added a little content? I mean, I don’t want to tell you how to run your blog, however what if you added
a headline that grabbed people’s attention? I mean The Wasteful Legacy of Programming as Language | Carlos Oliveira – Optimization & Engineering is kinda boring.
You could look at Yahoo’s home page and note how they create news headlines to grab people
interested. You might add a video or a pic or two to get people interested about
everything’ve written. In my opinion, it could bring
your website a little livelier.
Hello to all, the contents existing at this website are in fact
awesome for people knowledge, well, keep up the good work fellows.
Hmm it looks like your website ate my first comment (it was extremely long) so I guess I’ll just sum it up what I wrote
and say, I’m thoroughly enjoying your blog. I as well am an aspiring blog blogger but I’m still new to everything.
Do you have any points for beginner blog writers? I’d
certainly appreciate it.
I like the valuable info you supply on your
articles. I will bookmark your blog and check once more here frequently.
I am relatively certain I will be informed a lot of new stuff proper here!
Best of luck for the following!
Hi there! Do you know if they make any plugins to help
with Search Engine Optimization? I’m trying to get my blog
to rank for some targeted keywords but I’m not seeing very good results.
If you know of any please share. Kudos!
It’s an remarkable piece of writing in support of all the internet viewers; they will get benefit from
it I am sure.
Hello there! This post couldn’t be written any better!
Reading this post reminds me of my previous room mate!
He always kept chatting about this. I will forward this write-up to him.
Fairly certain he will have a good read. Thanks for
sharing!
My programmer is trying to persuade me to
move to .net from PHP. I have always disliked
the idea because of the costs. But he’s tryiong none the less.
I’ve been using Movable-type on a variety of websites for about a
year and am anxious about switching to another platform.
I have heard fantastic things about blogengine.net. Is there
a way I can transfer all my wordpress content into it?
Any kind of help would be really appreciated!
I have been surfing online more than 3 hours as of late,
yet I never discovered any attention-grabbing article like yours.
It’s beautiful worth enough for me. In my view, if all web owners and bloggers made good content as you did, the net will likely be much more helpful than ever before.
Hello would you mind sharing which blog platform you’re using?
I’m going to start my own blog in the near
future but I’m having a difficult time making a decision between BlogEngine/Wordpress/B2evolution and Drupal.
The reason I ask is because your layout seems different then most blogs and I’m looking for
something completely unique. P.S Sorry for getting off-topic but I had to ask!
It’s very trouble-free to find out any topic on net as compared to textbooks, as I found this article at this web page.