Does Task Complexity Moderate the Benefits of Liveness? A Controlled Experiment
Clicks: 24
ID: 283526
2024
Article Quality & Performance Metrics
Overall Quality
Not rated
Combines reader engagement with the AI quality analysis. This
article has not been analysed, so there is no overall score —
reader engagement is measured and shown alongside.
Reader Engagement
Emerging Content
6.9
/100
24 views
6 readers
AI Quality Assessment
Not analyzed
Readership in this journal
EmergingRanked #770 of 803 articles by views in arXiv
Most read
Least read
Bar heights use a square-root scale. Only the 120 most-read articles are drawn; the journal has 803 in total.
Mint this article as an NFT
Not yet mintedCreate a permanent, verifiable on-chain record of this article on the Scimatic Network. The NFT is held in your Journament account, and you can withdraw it to your own wallet at any time.
5
SUSD
one-off · no wallet required
Abstract
Live programming features can be found in a range of programming
environments, from individual prototypes to widely used environments. While
liveness is generally considered a useful property, there is little empirical
evidence on when and how liveness can be beneficial. Even though there are few
experimental studies, their results are largely inconclusive.
We reviewed existing experiments and related studies to gather a collection
of potential effects of liveness and moderating factors. Based on this
collection, we concluded that **task complexity** and **prior experience
addressing liveness** are potentially essential factors neglected in previous
experiments. To fill this gap, we devised and conducted a controlled experiment
(N = 37) testing the hypothesis that task complexity moderates the effects of
live introspection tools on participants? debugging efficiency, given
participants with prior experience with liveness.
Our results do not support the hypothesis that task complexity moderates the
effect of live introspection tools. This non-significant moderation effect
might result from the low number of participants, as the data suggests a
moderation effect. The results also show that in our experiment setting, live
introspection tools significantly reduced the time participants took to debug
the tasks.
For researchers interested in the effects of liveness, our findings suggest
that studies on liveness should make conscious choices about task complexity
and participants' prior experience with liveness. For designers of programming
environments, the results of our experiment are a step toward understanding
when and how programming tools should be live to become more helpful to
programmers.
| Reference Key |
hirschfeld2024does
Use this key to autocite in the manuscript while using
SciMatic Manuscript Manager or Thesis Manager
|
|---|---|
| Authors | Patrick Rein; Stefan Ramson; Tom Beckmann; Robert Hirschfeld |
| Journal | arXiv |
| Year | 2024 |
| DOI |
DOI not found
|
| URL | |
| Keywords |
Citations
No citations found. To add a citation, contact the admin at info@scimatic.org
Comments
No comments yet. Be the first to comment on this article.