Creativity research involves the need to score open-ended problems. Usually done by humans, automatic scoring using AI becomes more and more accurate. This package provides a simple interface to the ‘Open Scoring’ API, leading creativity scoring technology by Organiscak et al. (2023). With it, you can score your own data directly from an R script.
Install the released version of openscoring from CRAN with:
install.packages("openscoring")You can install the development version of openscoring from GitHub with:
# install.packages("devtools")
devtools::install_github("jakub-jedrusiak/openscoring")library(openscoring)
df <- tibble::tibble(
stimulus = c("brick", "hammer", "sponge"),
response = c("butter for trolls", "make Thor jealous", "make it play in a kids show")
)
df
#> # A tibble: 3 × 2
#> stimulus response
#> <chr> <chr>
#> 1 brick butter for trolls
#> 2 hammer make Thor jealous
#> 3 sponge make it play in a kids show
scored_df <- oscai(df, stimulus, response, model = "chatgpt2")
scored_df
#> # A tibble: 3 × 3
#> stimulus response .originality
#> <chr> <chr> <dbl>
#> 1 brick butter for trolls 3
#> 2 hammer make Thor jealous 3.5
#> 3 sponge make it play in a kids show 3.6The "1.5" model works for multiple languages:
df_polish <- tibble::tibble(
stimulus = c("cegła", "młotek", "gąbka"),
response = c("masło dla trolli", "wywoływanie zazdrości u Thora", "postać w programie dla dzieci")
)
oscai(df_polish, stimulus, response, model = "1.5", language = "Polish")
#> # A tibble: 3 × 3
#> stimulus response .originality
#> <chr> <chr> <dbl>
#> 1 cegła masło dla trolli 2.3
#> 2 młotek wywoływanie zazdrości u Thora 3.7
#> 3 gąbka postać w programie dla dzieci 2.3