Implementing "Generator" support in a custom language

Posted by Roger Alsing on Stack Overflow See other posts from Stack Overflow or by Roger Alsing
Published on 2010-04-15T10:54:50Z Indexed on 2010/04/15 14:23 UTC
Read the original article Hit count: 410

Filed under:

generators

|

yield

|

dsl

I've got a bit of fettish for language design and I'm currently playing around with my own hobby language. (http://rogeralsing.com/2010/04/14/playing-with-plastic/)

One thing that really makes my mind bleed is "generators" and the "yield" keyword. I know C# uses AST transformation to transform enumerator methods into statemachines.

But how does it work in other languages? Is there any way to get generator support in a language w/o AST transformation? e.g. Does languages like Python or Ruby resort to AST transformations to solve this to?

(The question is how generators are implemented under the hood in different languages, not how to write a generator in one of them)

© Stack Overflow or respective owner

Related posts about generators

10 CSS Grid Layout Generators

as seen on Just Skins - Search for 'Just Skins'
There are a lot of online generators which are of no use to any designers, however some can help designers to an extent. Some example of online generators are favicon generators, background generators, button generators, and badge generators. Some of the useful kinds are the ones that solve one purpose… >>> More
Where do you use generators feature in your python code?

as seen on Stack Overflow - Search for 'Stack Overflow'
I have studied generators feature and i think i got it but i would like to understand where i could apply it in my code. I have in mind the following example i read in "Python essential reference" book: # tail -f def tail(f): f.seek(0,2) while True: line = f.readline() if not line:… >>> More
Configuring JPA Primary key sequence generators

as seen on Oracle Blogs - Search for 'Oracle Blogs'
This article describes the JPA feature of generating and assigning the unique sequence numbers to JPA entity .This article provides information on jpa sequence generator annotations and its usage. UseCase Description Adding a new Employee to the organization using Employee form… >>> More
NHibernate Generators

as seen on Stack Overflow - Search for 'Stack Overflow'
What is the best tool for generating Entity Class and/or hbm files and/or sql script for NHibernate. This list below is from http://www.hibernate.org/365.html, which is the best any why? Moregen Free, Open Source (GPL) O/R Generator that can merge into existing Visual Studio Projects. Also merges… >>> More
Are there something like Python generators in Ruby?

as seen on Stack Overflow - Search for 'Stack Overflow'
I am new to Ruby, is there a way to yield values from Ruby functions? If yes, how? If not, what are my options to write lazy code? >>> More

Related posts about yield

Rails 3 - yield return or callback won't call in view <%= yield(:sidebar) || render('shared/sidebar'

as seen on Stack Overflow - Search for 'Stack Overflow'
Hey folks, I'm migrating a Website from Rails 2 (latest) to Rails 3 (beta2). Testing with Ruby 1.9.1p378 and Ruby 1.9.2dev (2010-04-05 trunk 27225) Stuck in a situation, i don't know which part will work well. Suspect yield is the problem, but don't know exactly. In my Layout Files I use the following… >>> More
What do you think of this generator syntax?

as seen on Programmers - Search for 'Programmers'
I've been working on an ECMAScript dialect for quite some time now and have reached a point where I am comfortable adding new language features. I would love to hear some thoughts and suggestions on the syntax. Example generator { yield 1; yield 2; yield 3; if (true) { yield… >>> More
C# yield return not returning an item as expected

as seen on Stack Overflow - Search for 'Stack Overflow'
I have following code: private void ProcessQueue() { foreach (MessageQueueItem item in GetNextQueuedItem()) PerformAction(item); } private IEnumerable<MessageQueueItem> GetNextQueuedItem() { if (_messageQueue.Count > 0) yield return _messageQueue.Dequeue(); } Initially… >>> More
What do you think of this iterator syntax?

as seen on Programmers - Search for 'Programmers'
I've been working on an ECMAScript dialect for quite some time now and have reached a point where I am comfortable adding new language features. I would love to hear some thoughts and suggestions on the syntax. Example iterator Numbers { yield 1; yield 2; yield 3; if (true) { … >>> More
yield in ERB without rails

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi How can I use yield for template inheritance in erb? I want to use erb in a plain ruby CGI script and want to use a base template and subtemplate like it Rails with the application template does. >>> More