肇庆市企业综合服务平台

关于我们

基于PPG脉搏波的血压监测传感器芯片及其制备方法

成果领域:

推广方式:

成果归属企业: 深圳大学

成果鉴定时间:

成果介绍

本发明公开了一种Spark分布式计算数据处理方法，涉及计算机领域，该方法包括：通过任务调度器调度子任务，执行RDD分区数据存储任务，申请存储区空间；计算存储区内可驱逐空间及空间的大小，根据分区数据访问热度设置混合存储系统的迁移地址；读取指定存储区内已缓存数据并释放相应的内存空间，迁移分区数据到指定地址，修改迁移数据的持久化级别，反馈驱逐成功信号及驱逐空间信息。本发明还公开了一种Spark分布式计算系统，通过引入混合存储系统，并设计驱逐逻辑单元和缓存数据迁移单元，根据分区数据热度将数据迁移至SSD或HDD，而非直接将数据迁移至磁盘或踢除已缓存的数据，能够有效地缓解内存空间不足的压力，实现Spark性能的提升。

成果应用案例介绍

方法过程>处理方法>数据处理方法; 计算控制>计算方法>spark分布式计算

联系方式

电话/微信: 13822630888

相关成果

免责声明 / 网站地图 / 平台简介 / 友情链接

邮箱：zeccea@qq.com QQ群：318441538 客服电话：0758-2721389 秘书处电话/微信：13822630888

基本文件流程错误 SQL 调试

/www/wwwroot/open.juabc.com/public/index.php ( 0.88 KB )
/www/wwwroot/open.juabc.com/thinkphp/start.php ( 0.72 KB )
/www/wwwroot/open.juabc.com/thinkphp/base.php ( 2.60 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Loader.php ( 21.07 KB )
/www/wwwroot/open.juabc.com/vendor/composer/autoload_static.php ( 10.16 KB )
/www/wwwroot/open.juabc.com/vendor/symfony/deprecation-contracts/function.php ( 0.98 KB )
/www/wwwroot/open.juabc.com/vendor/symfony/polyfill-php80/bootstrap.php ( 1.50 KB )
/www/wwwroot/open.juabc.com/vendor/symfony/polyfill-mbstring/bootstrap.php ( 7.07 KB )
/www/wwwroot/open.juabc.com/vendor/ralouphie/getallheaders/src/getallheaders.php ( 1.60 KB )
/www/wwwroot/open.juabc.com/vendor/guzzlehttp/guzzle/src/functions_include.php ( 0.16 KB )
/www/wwwroot/open.juabc.com/vendor/guzzlehttp/guzzle/src/functions.php ( 5.55 KB )
/www/wwwroot/open.juabc.com/vendor/symfony/polyfill-php73/bootstrap.php ( 0.99 KB )
/www/wwwroot/open.juabc.com/vendor/symfony/polyfill-php73/Php73.php ( 0.85 KB )
/www/wwwroot/open.juabc.com/vendor/ezyang/htmlpurifier/library/HTMLPurifier.composer.php ( 0.10 KB )
/www/wwwroot/open.juabc.com/vendor/topthink/think-helper/src/helper.php ( 2.88 KB )
/www/wwwroot/open.juabc.com/vendor/karsonzhang/fastadmin-addons/src/common.php ( 15.07 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Route.php ( 60.23 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Config.php ( 6.38 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Hook.php ( 4.71 KB )
/www/wwwroot/open.juabc.com/vendor/overtrue/wechat/src/Kernel/Support/Helpers.php ( 2.54 KB )
/www/wwwroot/open.juabc.com/vendor/overtrue/wechat/src/Kernel/Helpers.php ( 1.89 KB )
/www/wwwroot/open.juabc.com/vendor/topthink/think-captcha/src/helper.php ( 1.59 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Validate.php ( 41.63 KB )
/www/wwwroot/open.juabc.com/vendor/topthink/think-queue/src/common.php ( 1.19 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Console.php ( 23.13 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Error.php ( 3.75 KB )
/www/wwwroot/open.juabc.com/thinkphp/convention.php ( 10.37 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/App.php ( 21.58 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Request.php ( 49.78 KB )
/www/wwwroot/open.juabc.com/application/config.php ( 12.00 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Env.php ( 1.21 KB )
/www/wwwroot/open.juabc.com/application/database.php ( 2.32 KB )
/www/wwwroot/open.juabc.com/application/extra/addons.php ( 1.61 KB )
/www/wwwroot/open.juabc.com/application/extra/queue.php ( 0.55 KB )
/www/wwwroot/open.juabc.com/application/extra/site.php ( 0.95 KB )
/www/wwwroot/open.juabc.com/application/extra/upload.php ( 0.85 KB )
/www/wwwroot/open.juabc.com/application/tags.php ( 1.23 KB )
/www/wwwroot/open.juabc.com/application/common.php ( 17.49 KB )
/www/wwwroot/open.juabc.com/thinkphp/helper.php ( 17.30 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Debug.php ( 7.13 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Log.php ( 6.05 KB )
/www/wwwroot/open.juabc.com/addons/alisms/Alisms.php ( 2.01 KB )
/www/wwwroot/open.juabc.com/vendor/karsonzhang/fastadmin-addons/src/Addons.php ( 7.05 KB )
/www/wwwroot/open.juabc.com/addons/baiduidcard/Baiduidcard.php ( 4.04 KB )
/www/wwwroot/open.juabc.com/addons/customform/Customform.php ( 2.52 KB )
/www/wwwroot/open.juabc.com/addons/notice/Notice.php ( 2.76 KB )
/www/wwwroot/open.juabc.com/addons/briefurl/Briefurl.php ( 4.04 KB )
/www/wwwroot/open.juabc.com/addons/fastflow/Fastflow.php ( 13.08 KB )
/www/wwwroot/open.juabc.com/addons/qrcode/Qrcode.php ( 1.13 KB )
/www/wwwroot/open.juabc.com/addons/treaty/Treaty.php ( 2.78 KB )
/www/wwwroot/open.juabc.com/addons/upyun/Upyun.php ( 3.94 KB )
/www/wwwroot/open.juabc.com/addons/csmtable/Csmtable.php ( 4.89 KB )
/www/wwwroot/open.juabc.com/addons/editpage/Editpage.php ( 1.09 KB )
/www/wwwroot/open.juabc.com/addons/tablemake/Tablemake.php ( 6.04 KB )
/www/wwwroot/open.juabc.com/addons/wxfollowlogin/Wxfollowlogin.php ( 2.02 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Cache.php ( 6.10 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/cache/driver/File.php ( 7.27 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/cache/Driver.php ( 5.98 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/View.php ( 6.77 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/view/driver/Think.php ( 5.64 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Template.php ( 44.90 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/template/driver/File.php ( 2.24 KB )
/www/wwwroot/open.juabc.com/addons/briefurl/helper.php ( 2.03 KB )
/www/wwwroot/open.juabc.com/addons/briefurl/hooks.php ( 0.16 KB )
/www/wwwroot/open.juabc.com/addons/notice/library/common/helper.php ( 2.20 KB )
/www/wwwroot/open.juabc.com/addons/notice/library/common/extend.php ( 1.95 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/exception/HttpResponseException.php ( 0.93 KB )
/www/wwwroot/open.juabc.com/addons/notice/config.php ( 5.83 KB )
/www/wwwroot/open.juabc.com/vendor/myclabs/php-enum/src/Enum.php ( 8.00 KB )
/www/wwwroot/open.juabc.com/vendor/myclabs/php-enum/stubs/Stringable.php ( 0.20 KB )
/www/wwwroot/open.juabc.com/application/common/behavior/Common.php ( 3.02 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Lang.php ( 7.42 KB )
/www/wwwroot/open.juabc.com/thinkphp/lang/zh-cn.php ( 11.81 KB )
/www/wwwroot/open.juabc.com/application/index/lang/zh-cn.php ( 10.79 KB )
/www/wwwroot/open.juabc.com/extend/fast/Form.php ( 39.79 KB )
/www/wwwroot/open.juabc.com/addons/upyun/config.php ( 6.36 KB )
/www/wwwroot/open.juabc.com/application/index/controller/Results.php ( 15.13 KB )
/www/wwwroot/open.juabc.com/application/common/controller/Frontend.php ( 4.81 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Controller.php ( 6.07 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/traits/controller/Jump.php ( 4.90 KB )
/www/wwwroot/open.juabc.com/application/common/library/Auth.php ( 15.22 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Cookie.php ( 7.54 KB )
/www/wwwroot/open.juabc.com/application/common/model/Config.php ( 6.71 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Model.php ( 69.14 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Url.php ( 12.72 KB )
/www/wwwroot/open.juabc.com/addons/upyun/library/Upyun/Config.php ( 3.65 KB )
/www/wwwroot/open.juabc.com/addons/upyun/library/Upyun/Util.php ( 2.46 KB )
/www/wwwroot/open.juabc.com/addons/upyun/library/Upyun/Signature.php ( 2.68 KB )
/www/wwwroot/open.juabc.com/addons/upyun/library/Auth.php ( 0.96 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Db.php ( 6.67 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/db/connector/Mysql.php ( 3.89 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/db/Connection.php ( 29.97 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/db/Query.php ( 93.77 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/db/builder/Mysql.php ( 4.53 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/db/Builder.php ( 31.81 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/db/Expression.php ( 1.11 KB )
/www/wwwroot/open.juabc.com/runtime/temp/510d69063ba961eb258db1d11828a1c1.php ( 17.67 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/Response.php ( 8.28 KB )
/www/wwwroot/open.juabc.com/thinkphp/library/think/debug/Html.php ( 4.17 KB )

[ BEHAVIOR ] Run Closure @app_init [ RunTime:0.000013s ]
[ CACHE ] INIT File
[ BEHAVIOR ] Run \addons\briefurl\Briefurl @app_init [ RunTime:0.001417s ]
[ BEHAVIOR ] Run \addons\fastflow\Fastflow @app_init [ RunTime:0.000025s ]
[ BEHAVIOR ] Run \addons\notice\Notice @app_init [ RunTime:0.000248s ]
[ BEHAVIOR ] Run \addons\qrcode\Qrcode @app_init [ RunTime:0.000180s ]
[ BEHAVIOR ] Run \addons\treaty\Treaty @app_init [ RunTime:0.000043s ]
[ BEHAVIOR ] Run \addons\upyun\Upyun @app_init [ RunTime:0.000016s ]
[ BEHAVIOR ] Run Closure @app_init [ RunTime:0.000032s ]
[ BEHAVIOR ] Run app\common\behavior\Common @app_init [ RunTime:0.000233s ]
[ LANG ] /www/wwwroot/open.juabc.com/thinkphp/lang/zh-cn.php
[ BEHAVIOR ] Run app\common\behavior\Common @app_dispatch [ RunTime:0.000015s ]
[ ROUTE ] array ( 'type' => 'module', 'module' => array ( 0 => 'index', 1 => 'results', 2 => 'views', ), )
[ HEADER ] array ( 'connection' => 'keep-alive', 'cache-control' => 'max-age=0', 'x-forwarded-for' => '10.3.185.84', 'via' => '1.1 squid-proxy-5b96dc6d46-jtpgr (squid/6.13)', 'host' => 'www.zqqyzhfw.com', 'accept-encoding' => 'gzip, br, zstd, deflate', 'user-agent' => 'Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)', 'accept' => '*/*', 'content-type' => '', 'content-length' => '', )
[ PARAM ] array ( 'ids' => '5110', )
[ LANG ] /www/wwwroot/open.juabc.com/public/../application/index/lang/zh-cn.php
[ BEHAVIOR ] Run app\common\behavior\Common @module_init [ RunTime:0.000688s ]
[ BEHAVIOR ] Run \addons\upyun\Upyun @module_init [ RunTime:0.000120s ]
[ BEHAVIOR ] Run \addons\wxfollowlogin\Wxfollowlogin @module_init [ RunTime:0.000017s ]
[ BEHAVIOR ] Run \addons\upyun\Upyun @upload_config_init [ RunTime:0.000358s ]
[ BEHAVIOR ] Run \addons\editpage\Editpage @config_init [ RunTime:0.000030s ]
[ BEHAVIOR ] Run \addons\notice\Notice @config_init [ RunTime:0.000022s ]
[ DB ] INIT mysql
[ BEHAVIOR ] Run \addons\csmtable\Csmtable @action_begin [ RunTime:0.000049s ]
[ RUN ] app\index\controller\Results->views[ /www/wwwroot/open.juabc.com/application/index/controller/Results.php ]
[ VIEW ] /www/wwwroot/open.juabc.com/public/../application/index/view/results/views.html [ array ( 0 => 'user', 1 => 'site', 2 => 'config', 3 => 'data', 4 => 'active', 5 => 'login', 6 => 'catelist', 7 => 'views', ) ]
[ BEHAVIOR ] Run \addons\wxfollowlogin\Wxfollowlogin @view_filter [ RunTime:0.000044s ]

0.156029s