Package: pysparklyr 0.1.5.9002
pysparklyr: Provides a 'PySpark' Back-End for the 'sparklyr' Package
It enables 'sparklyr' to integrate with 'Spark Connect', and 'Databricks Connect' by providing a wrapper over the 'PySpark' 'python' library.
Authors:
pysparklyr_0.1.5.9002.tar.gz
pysparklyr_0.1.5.9002.zip(r-4.5)pysparklyr_0.1.5.9002.zip(r-4.4)pysparklyr_0.1.5.9002.zip(r-4.3)
pysparklyr_0.1.5.9002.tgz(r-4.4-any)pysparklyr_0.1.5.9002.tgz(r-4.3-any)
pysparklyr_0.1.5.9002.tar.gz(r-4.5-noble)pysparklyr_0.1.5.9002.tar.gz(r-4.4-noble)
pysparklyr_0.1.5.9002.tgz(r-4.4-emscripten)pysparklyr_0.1.5.9002.tgz(r-4.3-emscripten)
pysparklyr.pdf |pysparklyr.html✨
pysparklyr/json (API)
NEWS
# Install 'pysparklyr' in R: |
install.packages('pysparklyr', repos = c('https://mlverse.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/mlverse/pysparklyr/issues
databrickspysparksparkspark-connect
Last updated 2 months agofrom:144af42c89. Checks:OK: 7. Indexed: yes.
Target | Result | Date |
---|---|---|
Doc / Vignettes | OK | Oct 31 2024 |
R-4.5-win | OK | Oct 31 2024 |
R-4.5-linux | OK | Oct 31 2024 |
R-4.4-win | OK | Oct 31 2024 |
R-4.4-mac | OK | Oct 31 2024 |
R-4.3-win | OK | Oct 31 2024 |
R-4.3-mac | OK | Oct 31 2024 |
Exports:%>%connection_databricks_shinyappdeploy_databricksinstall_databricksinstall_pysparkinstalled_componentsml_prepare_datasetrequirements_writespark_connect_service_startspark_connect_service_stop
Dependencies:arrowaskpassassertthatbase64encbitbit64blobclicodetoolsconfigcpp11curlDBIdbplyrdigestdplyrfansifsgenericsglobalsglueherehttrhttr2jsonlitelatticelifecyclemagrittrMatrixmimeopensslpackratpillarpkgconfigPKIpngprocessxpspurrrR6rappdirsRcppRcppTOMLrenvreticulaterlangrprojrootrsconnectrstudioapisparklyrstringistringrsystibbletidyrtidyselectutf8uuidvctrswithrxml2yaml
Readme and manuals
Help Manual
Help page | Topics |
---|---|
Deploys Databricks backed content to publishing server | deploy_databricks |
Installs PySpark and Python dependencies | install_databricks install_pyspark |
Lists installed Python libraries | installed_components |
Creates the 'label' and 'features' columns | ml_prepare_dataset |
Writes the 'requirements.txt' file, containing the needed Python libraries | requirements_write |
Starts and stops Spark Connect locally | spark_connect_service_start spark_connect_service_stop |