Evaluating and comparing language workbenches Existing results and benchmarks for the future

Sebastian Erdweg; Tijs van der Storm; Markus Voelter; Laurence Tratt; Remi Bosman; William R. Cook; Albert Gerritsen; Angelo Hulshout; Steven Kelly; Alex Loh; Gabriel Konat; Pedro J. Molina; Martin Palatnik; Risto Pohjonen; Eugen Schindler; Klemens Schindler; Riccardo Solmi; Vlad Vergu; Eelco Visser; Kevin van der Vlist; Guido Wachsmuth; Jimi van der Woning

doi:10.1016/j.cl.2015.08.007

Evaluating and comparing language workbenches Existing results and benchmarks for the future

Sebastian Erdweg^*, Tijs van der Storm, Markus Voelter, Laurence Tratt, Remi Bosman, William R. Cook, Albert Gerritsen, Angelo Hulshout, Steven Kelly, Alex Loh, Gabriel Konat, Pedro J. Molina, Martin Palatnik, Risto Pohjonen, Eugen Schindler, Klemens Schindler, Riccardo Solmi, Vlad Vergu, Eelco Visser, Kevin van der VlistGuido Wachsmuth, Jimi van der Woning

^*Corresponding author for this work

Research output: Contribution to journal › Article › Academic › peer-review

148 Citations (Scopus)

Abstract

Language workbenches are environments for simplifying the creation and use of computer languages. The annual Language Workbench Challenge (LWC) was launched in 2011 to allow the many academic and industrial researchers in this area an opportunity to quantitatively and qualitatively compare their approaches. We first describe all four LWCs to date, before focussing on the approaches used, and results generated, during the third LWC. We give various empirical data for ten approaches from the third LWC. We present a generic feature model within which the approaches can be understood and contrasted. Finally, based on our experiences of the existing LWCs, we propose a number of benchmark problems for future LWCs. (C) 2015 Elsevier Ltd. All rights reserved.

Original language	English
Pages (from-to)	24-47
Number of pages	24
Journal	Computer Languages, Systems and Structures
Volume	44
DOIs	https://doi.org/10.1016/j.cl.2015.08.007
Publication status	Published - Dec-2015
Event	7th International Conference on Software Language Engineering (SLE) - Vasteras, Sweden Duration: 15-Sept-2014 → 16-Sept-2014

Keywords

Language workbenches
Domain-specific languages
Questionnaire language
Survey
Benchmarks

Access to Document

10.1016/j.cl.2015.08.007

Handle.net

Persistent link

Embargoed Document

Evaluating and comparing language workbenchesExisting results and benchmarks for the future
Final publisher's version, 6.89 MB
Request copy

Cite this

Erdweg, S., van der Storm, T., Voelter, M., Tratt, L., Bosman, R., Cook, W. R., Gerritsen, A., Hulshout, A., Kelly, S., Loh, A., Konat, G., Molina, P. J., Palatnik, M., Pohjonen, R., Schindler, E., Schindler, K., Solmi, R., Vergu, V., Visser, E., ... van der Woning, J. (2015). Evaluating and comparing language workbenches Existing results and benchmarks for the future. Computer Languages, Systems and Structures, 44, 24-47. https://doi.org/10.1016/j.cl.2015.08.007

@article{e029529ec1ee49a88ad55106be3c8ab0,

title = "Evaluating and comparing language workbenches Existing results and benchmarks for the future",

abstract = "Language workbenches are environments for simplifying the creation and use of computer languages. The annual Language Workbench Challenge (LWC) was launched in 2011 to allow the many academic and industrial researchers in this area an opportunity to quantitatively and qualitatively compare their approaches. We first describe all four LWCs to date, before focussing on the approaches used, and results generated, during the third LWC. We give various empirical data for ten approaches from the third LWC. We present a generic feature model within which the approaches can be understood and contrasted. Finally, based on our experiences of the existing LWCs, we propose a number of benchmark problems for future LWCs. (C) 2015 Elsevier Ltd. All rights reserved.",

keywords = "Language workbenches, Domain-specific languages, Questionnaire language, Survey, Benchmarks",

author = "Sebastian Erdweg and {van der Storm}, Tijs and Markus Voelter and Laurence Tratt and Remi Bosman and Cook, {William R.} and Albert Gerritsen and Angelo Hulshout and Steven Kelly and Alex Loh and Gabriel Konat and Molina, {Pedro J.} and Martin Palatnik and Risto Pohjonen and Eugen Schindler and Klemens Schindler and Riccardo Solmi and Vlad Vergu and Eelco Visser and {van der Vlist}, Kevin and Guido Wachsmuth and {van der Woning}, Jimi",

year = "2015",

month = dec,

doi = "10.1016/j.cl.2015.08.007",

language = "English",

volume = "44",

pages = "24--47",

journal = "Computer Languages, Systems and Structures",

issn = "1477-8424",

publisher = "PERGAMON-ELSEVIER SCIENCE LTD",

note = "7th International Conference on Software Language Engineering (SLE) ; Conference date: 15-09-2014 Through 16-09-2014",

}

Erdweg, S, van der Storm, T, Voelter, M, Tratt, L, Bosman, R, Cook, WR, Gerritsen, A, Hulshout, A, Kelly, S, Loh, A, Konat, G, Molina, PJ, Palatnik, M, Pohjonen, R, Schindler, E, Schindler, K, Solmi, R, Vergu, V, Visser, E, van der Vlist, K, Wachsmuth, G & van der Woning, J 2015, 'Evaluating and comparing language workbenches Existing results and benchmarks for the future', Computer Languages, Systems and Structures, vol. 44, pp. 24-47. https://doi.org/10.1016/j.cl.2015.08.007

TY - JOUR

T1 - Evaluating and comparing language workbenches Existing results and benchmarks for the future

AU - Erdweg, Sebastian

AU - van der Storm, Tijs

AU - Voelter, Markus

AU - Tratt, Laurence

AU - Bosman, Remi

AU - Cook, William R.

AU - Gerritsen, Albert

AU - Hulshout, Angelo

AU - Kelly, Steven

AU - Loh, Alex

AU - Konat, Gabriel

AU - Molina, Pedro J.

AU - Palatnik, Martin

AU - Pohjonen, Risto

AU - Schindler, Eugen

AU - Schindler, Klemens

AU - Solmi, Riccardo

AU - Vergu, Vlad

AU - Visser, Eelco

AU - van der Vlist, Kevin

AU - Wachsmuth, Guido

AU - van der Woning, Jimi

PY - 2015/12

Y1 - 2015/12

N2 - Language workbenches are environments for simplifying the creation and use of computer languages. The annual Language Workbench Challenge (LWC) was launched in 2011 to allow the many academic and industrial researchers in this area an opportunity to quantitatively and qualitatively compare their approaches. We first describe all four LWCs to date, before focussing on the approaches used, and results generated, during the third LWC. We give various empirical data for ten approaches from the third LWC. We present a generic feature model within which the approaches can be understood and contrasted. Finally, based on our experiences of the existing LWCs, we propose a number of benchmark problems for future LWCs. (C) 2015 Elsevier Ltd. All rights reserved.

AB - Language workbenches are environments for simplifying the creation and use of computer languages. The annual Language Workbench Challenge (LWC) was launched in 2011 to allow the many academic and industrial researchers in this area an opportunity to quantitatively and qualitatively compare their approaches. We first describe all four LWCs to date, before focussing on the approaches used, and results generated, during the third LWC. We give various empirical data for ten approaches from the third LWC. We present a generic feature model within which the approaches can be understood and contrasted. Finally, based on our experiences of the existing LWCs, we propose a number of benchmark problems for future LWCs. (C) 2015 Elsevier Ltd. All rights reserved.

KW - Language workbenches

KW - Domain-specific languages

KW - Questionnaire language

KW - Survey

KW - Benchmarks

U2 - 10.1016/j.cl.2015.08.007

DO - 10.1016/j.cl.2015.08.007

M3 - Article

SN - 1477-8424

VL - 44

SP - 24

EP - 47

JO - Computer Languages, Systems and Structures

JF - Computer Languages, Systems and Structures

T2 - 7th International Conference on Software Language Engineering (SLE)

Y2 - 15 September 2014 through 16 September 2014

ER -

Evaluating and comparing language workbenches Existing results and benchmarks for the future

Abstract

Keywords

Access to Document

Handle.net

Embargoed Document

Fingerprint

Cite this