文件名称:jqfbsdukj
-
所属分类:
- 标签属性:
- 上传时间:2014-01-22
-
文件大小:581.92kb
-
已下载:0次
-
提 供 者:
-
相关连接:无下载说明:别用迅雷下载,失败请重下,重下不扣分!
介绍说明--下载内容来自于网络,使用问题请自行百度
集群分布式多进程GP调度框架
我们经常会利用ArcGIS GP工具来进行一些大规模数据批处理工作,但是由于GP其实也是调用底层基于COM的AO,多线程的效率往往体现不出来,因为大家知道ArcGIS Engine GP是无法在多线程环境下高效稳定运行的,特别是当需要处理大规模数据集时,基于单台机器单进程程序就无法解决了。
本调度程序能够解决单一机器单进程调用效率低的问题,特别是基于COM的应用程序,本程序有以下特点。
1、 多机器进去调度器
2、 多进程调度
3、 能够解决GP不支持多线程调用的问题
集群分布式多进程GP框架提出了一个基于多机器、多进程、分布式的统一调度执行框架。也就是说,将要处理的数据由一台调度服务器去分配到多个机器、多个进程里面去并行执行,充分利用多机器,多CPU、多核的并行运算效率。
-GP distributed multi-cluster scheduling process framework, we often use ArcGIS GP tools to carry out some large-scale data batch job, but because GP is actually calling the underlying COM-based AO, often reflected the efficiency of multi-threading does not come out, because we know ArcGIS Engine GP is not efficient and stable operation in a multi-threaded environment, especially when the need to process large data sets, based on a single machine single-process program can not be solved. The scheduler can solve the low efficiency of a single process on a single machine to call the question, especially COM-based applications, this program has the following characteristics. 1, 2 multiple machines into the scheduler, multi-process scheduling 3, can solve the problem GP does not support multi-threaded distributed multi-cluster call GP process execution framework proposed a unified framework based on multi-machine, multi-process, distributed. In other words, the data will be processed by a s
我们经常会利用ArcGIS GP工具来进行一些大规模数据批处理工作,但是由于GP其实也是调用底层基于COM的AO,多线程的效率往往体现不出来,因为大家知道ArcGIS Engine GP是无法在多线程环境下高效稳定运行的,特别是当需要处理大规模数据集时,基于单台机器单进程程序就无法解决了。
本调度程序能够解决单一机器单进程调用效率低的问题,特别是基于COM的应用程序,本程序有以下特点。
1、 多机器进去调度器
2、 多进程调度
3、 能够解决GP不支持多线程调用的问题
集群分布式多进程GP框架提出了一个基于多机器、多进程、分布式的统一调度执行框架。也就是说,将要处理的数据由一台调度服务器去分配到多个机器、多个进程里面去并行执行,充分利用多机器,多CPU、多核的并行运算效率。
-GP distributed multi-cluster scheduling process framework, we often use ArcGIS GP tools to carry out some large-scale data batch job, but because GP is actually calling the underlying COM-based AO, often reflected the efficiency of multi-threading does not come out, because we know ArcGIS Engine GP is not efficient and stable operation in a multi-threaded environment, especially when the need to process large data sets, based on a single machine single-process program can not be solved. The scheduler can solve the low efficiency of a single process on a single machine to call the question, especially COM-based applications, this program has the following characteristics. 1, 2 multiple machines into the scheduler, multi-process scheduling 3, can solve the problem GP does not support multi-threaded distributed multi-cluster call GP process execution framework proposed a unified framework based on multi-machine, multi-process, distributed. In other words, the data will be processed by a s
(系统自动生成,下载前可以参看下载内容)
下载文件列表
NLog.dll
Solution.sln
Solution.v11.suo
WorkerClinet/
WorkerClinet/App.config
WorkerClinet/FileOperation.cs
WorkerClinet/IWorerCommiter.cs
WorkerClinet/NLog.config
WorkerClinet/Properties/
WorkerClinet/Properties/AssemblyInfo.cs
WorkerClinet/TarFileWatcher.cs
WorkerClinet/WCFClient.cs
WorkerClinet/WorkerCommitClinet.csproj
WorkerClinet/WorkerCommiter.cs
WorkerClinet/YourJob.cs
WorkerClinet/bin/
WorkerClinet/bin/Debug/
WorkerClinet/obj/
WorkerClinet/obj/Debug/
WorkerClinet/obj/Debug/DesignTimeResolveAssemblyReferencesInput.cache
WorkerClinet/obj/Debug/TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
WorkerClinet/obj/Debug/TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
WorkerClinet/obj/Debug/TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
WorkerClinet/obj/Debug/WorkerClinet.csproj.FileListAbsolute.txt
WorkerClinet/obj/Debug/WorkerClinet.csprojResolveAssemblyReference.cache
WorkerClinet/obj/Debug/WorkerClinet.exe
WorkerClinet/obj/Debug/WorkerClinet.pdb
WorkerClinet/obj/Debug/WorkerCommitClinet.csproj.FileListAbsolute.txt
WorkerClinet/obj/Debug/WorkerCommitClinet.csprojResolveAssemblyReference.cache
WorkerClinet/obj/Debug/WorkerCommitClinet.exe
WorkerClinet/obj/Debug/WorkerCommitClinet.pdb
WorkerEntities/
WorkerEntities/IProcessManagerService.cs
WorkerEntities/IProcessorReportService.cs
WorkerEntities/IProcessorStratInfoService.cs
WorkerEntities/IWCFMSMQService.cs
WorkerEntities/IWCFServices.cs
WorkerEntities/IWorkerAssign.cs
WorkerEntities/IWorkerServerConnection.cs
WorkerEntities/IWrokerServer.cs
WorkerEntities/JobParameter.cs
WorkerEntities/ProcessorEntity.cs
WorkerEntities/Properties/
WorkerEntities/Properties/AssemblyInfo.cs
WorkerEntities/SPI/
WorkerEntities/SPI/IJobSPI.cs
WorkerEntities/WorkerEntities.csproj
WorkerEntities/bin/
WorkerEntities/bin/Debug/
WorkerEntities/obj/
WorkerEntities/obj/Debug/
WorkerEntities/obj/Debug/DesignTimeResolveAssemblyReferencesInput.cache
WorkerEntities/obj/Debug/TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
WorkerEntities/obj/Debug/TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
WorkerEntities/obj/Debug/TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
WorkerEntities/obj/Debug/WorkerEntities.csproj.FileListAbsolute.txt
WorkerEntities/obj/Debug/WorkerEntities.dll
WorkerEntities/obj/Debug/WorkerEntities.pdb
WorkerInstance/
WorkerInstance/App.config
WorkerInstance/Client.cs
WorkerInstance/GPJob.cs
WorkerInstance/Program.cs
WorkerInstance/Properties/
WorkerInstance/Properties/AssemblyInfo.cs
WorkerInstance/WorkerInstance.csproj
WorkerInstance/bin/
WorkerInstance/bin/Debug/
WorkerInstance/gp/
WorkerInstance/gp/AEInit.cs
WorkerInstance/gp/AEUtil.cs
WorkerInstance/gp/FileParameter.cs
WorkerInstance/gp/GPUtil.cs
WorkerInstance/gp/InterpolationToolsFacotry.cs
WorkerInstance/gp/Setting.cs
WorkerInstance/gp/SpatialOperation.cs
WorkerInstance/obj/
WorkerInstance/obj/Debug/
WorkerInstance/obj/Debug/DesignTimeResolveAssemblyReferencesInput.cache
WorkerInstance/obj/Debug/TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
WorkerInstance/obj/Debug/TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
WorkerInstance/obj/Debug/TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
WorkerInstance/obj/Debug/WorkerInstance.csproj.FileListAbsolute.txt
WorkerInstance/obj/Debug/WorkerInstance.csprojResolveAssemblyReference.cache
WorkerInstance/obj/Debug/WorkerInstance.dll
WorkerInstance/obj/Debug/WorkerInstance.pdb
WorkerProcessManage/
WorkerProcessManage/App.config
WorkerProcessManage/Command.cs
WorkerProcessManage/IReportResult.cs
WorkerProcessManage/Job/
WorkerProcessManage/Job/Client/
WorkerProcessManage/Job/Client/ClientProxy.cs
WorkerProcessManage/Job/JobStartManager.cs
WorkerProcessManage/Job/ProcessManagerService.cs
WorkerProcessManage/Job/ProcessorReportService.cs
WorkerProcessManage/Job/RPCServer.cs
WorkerProcessManage/Job/RPCServerConnection.cs
WorkerProcessManage/Job/ReporServerConnection.cs
WorkerProcessManage/Job/WrokApply.cs
WorkerProcessManage/Mainfrm.cs
WorkerProcessManage/Mainfrm.designer.cs
WorkerProcessManage/Mainfrm.resx
WorkerProcessManage/NLog.config
WorkerProcessManage/ProcessMan/
WorkerProcessManage/ProcessMan/ProcessManager.cs
WorkerProcessManage/Program.cs
WorkerProcessManage/Properties/
WorkerProcessManage/Properties/AssemblyInfo.cs
WorkerProcessManage/Properties/Resources.Designer.cs
WorkerProcessManage/Properties/Resources.resx
WorkerProcessManage/Properties/licenses.licx
WorkerProcessManage/ReporFrm.cs
WorkerProcessManage/ReporFrm.designer.cs
WorkerProcessManage/ReporFrm.resx
WorkerProcessManage/Resources/
WorkerProcessManage/Resources/2897814_144722554130_2.gif
WorkerProcessManage/SystemInfo/
WorkerProcessManage/SystemInfo/CustomtMarshaler.cs
WorkerProcessManage/SystemInfo/DiskInfo.cs
WorkerProcessManage/SystemInfo/IpInfo.cs
WorkerProcessManage/SystemInfo/MIB_IFROW.cs
WorkerProcessManage/SystemInfo/MIB_IFTABLE.cs
WorkerProcessManage/SystemInfo/NetInfo.cs
WorkerProcessManage/SystemInfo/ProcessInfo.cs
WorkerProcessManage/SystemInfo/SystemData.cs
WorkerProcessManage/Syst
Solution.sln
Solution.v11.suo
WorkerClinet/
WorkerClinet/App.config
WorkerClinet/FileOperation.cs
WorkerClinet/IWorerCommiter.cs
WorkerClinet/NLog.config
WorkerClinet/Properties/
WorkerClinet/Properties/AssemblyInfo.cs
WorkerClinet/TarFileWatcher.cs
WorkerClinet/WCFClient.cs
WorkerClinet/WorkerCommitClinet.csproj
WorkerClinet/WorkerCommiter.cs
WorkerClinet/YourJob.cs
WorkerClinet/bin/
WorkerClinet/bin/Debug/
WorkerClinet/obj/
WorkerClinet/obj/Debug/
WorkerClinet/obj/Debug/DesignTimeResolveAssemblyReferencesInput.cache
WorkerClinet/obj/Debug/TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
WorkerClinet/obj/Debug/TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
WorkerClinet/obj/Debug/TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
WorkerClinet/obj/Debug/WorkerClinet.csproj.FileListAbsolute.txt
WorkerClinet/obj/Debug/WorkerClinet.csprojResolveAssemblyReference.cache
WorkerClinet/obj/Debug/WorkerClinet.exe
WorkerClinet/obj/Debug/WorkerClinet.pdb
WorkerClinet/obj/Debug/WorkerCommitClinet.csproj.FileListAbsolute.txt
WorkerClinet/obj/Debug/WorkerCommitClinet.csprojResolveAssemblyReference.cache
WorkerClinet/obj/Debug/WorkerCommitClinet.exe
WorkerClinet/obj/Debug/WorkerCommitClinet.pdb
WorkerEntities/
WorkerEntities/IProcessManagerService.cs
WorkerEntities/IProcessorReportService.cs
WorkerEntities/IProcessorStratInfoService.cs
WorkerEntities/IWCFMSMQService.cs
WorkerEntities/IWCFServices.cs
WorkerEntities/IWorkerAssign.cs
WorkerEntities/IWorkerServerConnection.cs
WorkerEntities/IWrokerServer.cs
WorkerEntities/JobParameter.cs
WorkerEntities/ProcessorEntity.cs
WorkerEntities/Properties/
WorkerEntities/Properties/AssemblyInfo.cs
WorkerEntities/SPI/
WorkerEntities/SPI/IJobSPI.cs
WorkerEntities/WorkerEntities.csproj
WorkerEntities/bin/
WorkerEntities/bin/Debug/
WorkerEntities/obj/
WorkerEntities/obj/Debug/
WorkerEntities/obj/Debug/DesignTimeResolveAssemblyReferencesInput.cache
WorkerEntities/obj/Debug/TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
WorkerEntities/obj/Debug/TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
WorkerEntities/obj/Debug/TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
WorkerEntities/obj/Debug/WorkerEntities.csproj.FileListAbsolute.txt
WorkerEntities/obj/Debug/WorkerEntities.dll
WorkerEntities/obj/Debug/WorkerEntities.pdb
WorkerInstance/
WorkerInstance/App.config
WorkerInstance/Client.cs
WorkerInstance/GPJob.cs
WorkerInstance/Program.cs
WorkerInstance/Properties/
WorkerInstance/Properties/AssemblyInfo.cs
WorkerInstance/WorkerInstance.csproj
WorkerInstance/bin/
WorkerInstance/bin/Debug/
WorkerInstance/gp/
WorkerInstance/gp/AEInit.cs
WorkerInstance/gp/AEUtil.cs
WorkerInstance/gp/FileParameter.cs
WorkerInstance/gp/GPUtil.cs
WorkerInstance/gp/InterpolationToolsFacotry.cs
WorkerInstance/gp/Setting.cs
WorkerInstance/gp/SpatialOperation.cs
WorkerInstance/obj/
WorkerInstance/obj/Debug/
WorkerInstance/obj/Debug/DesignTimeResolveAssemblyReferencesInput.cache
WorkerInstance/obj/Debug/TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
WorkerInstance/obj/Debug/TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
WorkerInstance/obj/Debug/TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
WorkerInstance/obj/Debug/WorkerInstance.csproj.FileListAbsolute.txt
WorkerInstance/obj/Debug/WorkerInstance.csprojResolveAssemblyReference.cache
WorkerInstance/obj/Debug/WorkerInstance.dll
WorkerInstance/obj/Debug/WorkerInstance.pdb
WorkerProcessManage/
WorkerProcessManage/App.config
WorkerProcessManage/Command.cs
WorkerProcessManage/IReportResult.cs
WorkerProcessManage/Job/
WorkerProcessManage/Job/Client/
WorkerProcessManage/Job/Client/ClientProxy.cs
WorkerProcessManage/Job/JobStartManager.cs
WorkerProcessManage/Job/ProcessManagerService.cs
WorkerProcessManage/Job/ProcessorReportService.cs
WorkerProcessManage/Job/RPCServer.cs
WorkerProcessManage/Job/RPCServerConnection.cs
WorkerProcessManage/Job/ReporServerConnection.cs
WorkerProcessManage/Job/WrokApply.cs
WorkerProcessManage/Mainfrm.cs
WorkerProcessManage/Mainfrm.designer.cs
WorkerProcessManage/Mainfrm.resx
WorkerProcessManage/NLog.config
WorkerProcessManage/ProcessMan/
WorkerProcessManage/ProcessMan/ProcessManager.cs
WorkerProcessManage/Program.cs
WorkerProcessManage/Properties/
WorkerProcessManage/Properties/AssemblyInfo.cs
WorkerProcessManage/Properties/Resources.Designer.cs
WorkerProcessManage/Properties/Resources.resx
WorkerProcessManage/Properties/licenses.licx
WorkerProcessManage/ReporFrm.cs
WorkerProcessManage/ReporFrm.designer.cs
WorkerProcessManage/ReporFrm.resx
WorkerProcessManage/Resources/
WorkerProcessManage/Resources/2897814_144722554130_2.gif
WorkerProcessManage/SystemInfo/
WorkerProcessManage/SystemInfo/CustomtMarshaler.cs
WorkerProcessManage/SystemInfo/DiskInfo.cs
WorkerProcessManage/SystemInfo/IpInfo.cs
WorkerProcessManage/SystemInfo/MIB_IFROW.cs
WorkerProcessManage/SystemInfo/MIB_IFTABLE.cs
WorkerProcessManage/SystemInfo/NetInfo.cs
WorkerProcessManage/SystemInfo/ProcessInfo.cs
WorkerProcessManage/SystemInfo/SystemData.cs
WorkerProcessManage/Syst
本网站为编程资源及源代码搜集、介绍的搜索网站,版权归原作者所有! 粤ICP备11031372号
1999-2046 搜珍网 All Rights Reserved.