简介:InHL-2Atokamak,aprogramtogetthedatafromthevacuummeterhasbeendevelopedin2003.Theprogramisusedtoreadandrecordthedataoftheneutralgaspressureduringtheexperiment.Sohowtocommunicatebetweenalocalcomputerandthevacuummeterviaserial-portcommunicationisintroducedinthispaper.ThearchitectureofthesystemisshowninFig.1.
简介:InthisarticlewewillintroducethesystemstructureofamodelbuiltforBESdatamanagementandstorageaswellasthebasicmethodsonhowtoestablishthesystem.Additionallytheanalysisofthedatastructure,thedataprocess,theselectionofexperimentalprogram,theimagemanipulationandthekeytechniqueswillbediscussedindetail,Themodelimplementsthesetupofthesystemenvironmentandallthosefunctionsfromdataloading,databasecresting,dataaccessing,remotedataprocesstodatafiguring.
简介:Thenecessitytodistributethedataoverthewideareanetwork(WAN)tothephysicists'homeinstituteswillincrease,andtheeffectiveutilizationofthenetworkbecomescrucial,However,networksinthefutureWANwilltypicallyhavealargebandwidthatanorderofgigabitpersecond,withalatencyofseveralhundredssecondssothatthelargebandwidth-delayprodeuctextendstotensofmegabytesandnumerousproblemsareencountered.suchnetworksarecalled"longfatnetworks(LFNs)"Inordertostudythedatatransferoperatingonalongfatnetwork,wehavebuiltthePCclustersconnectedwiththerouterwhichcansimulatebandwidthlimitations.delays,packetlosses,andmultipatheffects.thisrouterisrunningonFreeBSDwithDUMMYNETkerneloption.Onthesemachineswehavemeasuredtheperformanceofthebulkdatatransfterwithnumerousconditionsandstudiedtheeffecienttransftermethods.
简介:Afterlessthanayearofoperation,theBaBarexperimentatSLAChascollectedalmost100millionparticlecollisioneventsinadatabaseapproaching165TB.Around20TBofdatahasbeenexportedviatheInternettotheBaBarregionalcenteratIN2P3inLyon,France,andaround40TBofsimulateddatahasbeenimportedfromtheLawrenceLivermoreNationalLaboratory(LLNL),BaBarCollaboratorsplantodoubledatacollectioneachyearandexportathirdofthedatatoIN2P3.SowithinafewyearstheSLACOC3(155Mbps)connectionwillbefullyutilizedbyfiletransfertoFrancealone.Upgradestoinfrastructureisessentialanddetailedunderstandingofperformanceissuesandtherequirementsforreliablehighthroughputtransfersiscritical.Inthistalkresultsfromactiveandpassivemonitoringanddirectmeasurementsofthroughputwillbereviewed.Methodsforachievingtheambitiousrequirementswillbediscussed.
简介:Thisarticleisaboutapieceofmiddleware,allowingtoconvertadumptapebasedTertiaryStorageSystemintoamultipetabyterandomaccessdevicewiththousandsofchannels.Usingtypicalcachingmechanisms,thesoftwareoptimizestheaccesstotheunderlyingStorageSystemandmakesbetteruseofpossiblyexpensivedrivesandrobotsorallowstointegratecheapandslowdeviceswithoutintroducingunacceptableperformancedegadation.Inaddition,usingthestandardNFS2protocol,thedCacheprovidesauniqueviewintothestoragerepository,hidingthephysicallocationofthefiledata,cachedortapeonly.BulkdatatransferissupportedthroughthekerberizedFTPprotocolandaC-API,providingtheposixfileaccesssemantics,Datasetstaginganddiskspacemanagementisperformedinvisiblytothedataclients.TheprojectisaDESY,FermilabjointefforttoovercomelimitationsintheusageoftertiarystorageresourcescommontomanyHEPlabs.ThedistributedcachenodesmayrangefromhighperformanceSGImachinestocommodityCERNLinux-IDElikefileservermodels.Differentcachenodesareassumedtohavedifferentaffinitiestoparticularstoragegroupsorfilesets.AffinitiesmaybedefinedmanuallyorarecalculatedbythedCachebasedontopologyconsiderations.Cachenodesmayhavedifferentdiskspacemanagementpoliciestomatchthelargevarietyofapplicationsfromrawdatatouseranalysisdatapools.
简介:TheALICEdetectoratLHC(CERN),willrecordrawdataatarateof1.2Gigabytespersecond.TryingtoanalyseallthisdataatCRNwillnotbefeasible.AsoriginallyproposedbytheMONARCproject,dtacollectedatCERNwillbetransferredtoremotecentrestousetheircomputinginfrastructure,Theremotecentreswillreconstructandanalysetheevents.andmakeavailabletheresults.Thereforehigh-ratedatatransferbetweencomputingcentres(Tiers)willbecomeofparamountimportance.ThispaperwillpresentseveralteststhathavebeenmadebetweenCERNandremotecentresinPadova(Italy),Torino(Italy),Catania(Italy),Lyon(France),Ohio(UnitedStates),Warsaw(Poland)andCalcutta(India),Thesetestsconsisted,inafirststage,ofsendingrawdatafromCERNtotheremotecentresandback,usingaftpmethodthatallowsconnectionsofseveralstreamsatthesametime.Thankstothesemultiplestreams,itispossilbletoincreasetherateatwhichthedataistransferred.Whileseveral"multiplestreamftpsolutions"alreadyexist,ourmethodisbasedonaparallelsocketimplementationwhichallows,besidesfiles,alsoobjects(oranylargemessage)tobesendinparallel.Aprototypewillbepresentedabletomanagedifferenttransfers.Thisisthefirststepofasystemtobeimplementedthatwillbeabletotakecareoftheconnectionswiththeremotecentrestoexchangedataandmonitorthestatusofthetransfer.
简介:ATLAS[1]hasrecentlyjoinedGaudi,anopenprojecttodevelopadataprocessingframeworkforHEPexperiments[2],ThedatamodelisoneoftheareaswhereATLAShasextendedmoretheoriginalGaudidesigntomeettheexperiment'sownrequirments.ThispaperdescribesStoreGate,thefirstimplementationoftheATLASDataModel.
简介:ARGO-YBJ,aChinese-ItalianCollaboration,isgoingtofinishthefirststepoftheinstallationofthiscosmicraytelescopeconsistinginasinglelayerofRPCs,placedat4300m.elevation,inTibet,Thedetectorwillprovideadetailedspace-timepictureoftheshowersfront,initiatedbyprimariesofenergiesintherange10GeV-500TeV.Thedatatakingwillstartatthebeginningof2002withafractionofthedetectorinstalled.willbeupgradedtwotimes,beingcompletedattheendof2003,Inthispaperwebrieflydescribethedataflow,thetriggerorganization,thethreeoperationalstepsindatatakingandthecomputingmodeltoprocessthedata.theneedofremotemonitoringoftheexperimentwillbetouchedupon.TheprocessingpowerfortherawdatareconstructionandfortheMonteCarlosimulationisreported.
简介:Inhigh-energyphysics,terabyteandsoonpetabyte-scaledatacollectionsareemergingascriticalcommunityresources.Anewclassof"DataGrid"infrastructureisrequiredtosupportdistributedaccesstoandanalysisofthesedatasetsbypotentiallythousandsofusers.DataGridtechnologyisbeingdeployedinnumerousexperimentsthroughcollaborationssuchastheEUDataGrid,theGridPhysicsNetwork,andtheParticelPhysicsDataGrid[1],TheGlobusToolkitisawidelyusedsetofservicesdesignedtosupportthecreationoftheseGridinfrastruncturesandapplications,InthispaperwesurveytheGlobustechnologiesthatwillplayamajorroleinthedevelopmentanddeploymentfortheseGrids.
简介:AthenaisthecommonframeworkusedbytheATLASexperimentforsimulation,reconstruction,andanalysis,Bydesign,Athenasupportsmultiplepersistenceservices,andinsulatesusersfromtechnology-specificpersistencedetails.AthenausersandevenmostAthenapackagedevelopersshouldneitherknownorcarewhetherdatacomefromthegridorfromlocalfilesystems.norwhetherdataresideinobjectdatabases,inROOTorZEBRAfiles,orinASCIIfiles.InthispaperwedescribehowAthenaapplicationsmaytransparentlytakeadvantageofemergingservicesprovidedbygridsoftwaretoday-howdatageneratedbyAtheajobsareregisteredingridreplicacatalogsandothercollectionmanagementservices,andthemeansbywhichinputdataareidentifiedandlocatedinagrid-awarecollectionmanagementenvironment.Weoutlineanevolutionarypathtowardincorporationofgrid-basedvirtualdataservices,wherebylocatingdatamaybereplacedbylocatingarecipeaccordingtowhichthatdtamaybegenerated.Severalimplementationscenarios,rangingfromlowlevelgridcatalogservices(e.g.,fromGlobus)throughhigher-levelservicessuchastheGridDataManagementPilot(underdevelopmentaspartoftheEuropeanDataGridporject,incollaboration,withtheParticlePhysicsDataGrid)tomoreconventionaldatabaseservices,andacommonarchitecturetosupportthesevariousscenarios,arealsodescribed.
简介:TheANTAREScollaborationisbuildingadeepunderwaterneutrinotelescopetobeimmersedintheMediterraneanSea40kmofftheFrenchcoast.ThisdetectorwillbeabletodetecttheCherenkovlightemittedbymuonsproducedinneutrinointeractionsusingathree-dimensionalmatrixofopticalsensors,Thetelescopewillbemadeofnearly1000oftheseelementaryunitsdistributedoverawideareaofabout0.1km2atanaveragedepthof2400mInordertoreachasub-nanosecondresolutiononlighpulsedetection,signalsfromallOMsareanalyzedanddigitizedlocallybeforebeingsenttoshorethrougha50kmelectro-opticalcable,Front-endelectronics,timealignment(clockdistribution),TriggeringanddataacquistitionforsuchalargeandremotedetectorrepresentarealhallengeandrequiredconsiderableR&Dstudies,Thetechnicalsolutionsadoptedbythecollaborationwillbedescribedandtheirperformancesdiscussed.
简介:FormorethanoneyeartheCLEOⅢexperimentattheCornellelectronpositronstorageringCESRhasaccumulatedPhysicsdatausinga4layersiliconvertexdetectorandanovelringimageCherenkovdetector,alongwithaconventionalDriftchamber,E.M.calorimeterandmuonchambers.BythetimeofCHEP2001theexperimenthasaccumulated10fb^-1ofdata,Thereadoutandmonitoringsystemscontrol,ca.400000electronicchannels.Detectorconfiguration.dataqualityandcomponentmonitoring,runcontrolareonlysomeoftheSlowControltasksthathavetobeperformed.DeployingindustrystandardssuchasCORBA(inter-platformcommunication)Java(remoteaccessviaWebbrowser)andObjectivity(eventandconstantsdatabse)asbuildingblocksofthecomputernetworkhasbeenofcentralimportance.Objectorienteddesignhasenabledtheseamlessintegrationofthemanyindividualcomponents.Inourpresentationwewilldescribeexperienceswiththisdistributedcontrolsystemandgiveareportofthemeasurestakentoobtainahighsystemavailability.
简介:Backgroundknowledgeisimportantfordatamining,especiallyincomplicatedsituation.Ontologicalengineeringisthesuccessorofknowledgeengineering.Thesharableknowledgebasesbuiltonontologycanbeusedtoprovidebackgroundknowledgetodirecttheprocessofdatamining.ThispapergivesacommonintroductiontothemethodandpresentsapracticalanalysisexampleusingSVM(supportvectormachine)astheclassifier.GeneOntologyandtheaccompanyingannotationscomposeabigknowledgebase,onwhichmanyresearcheshavebeencarriedout.MicroarraydatasetistheoutputofDNAchip.WiththehelpofGeneOntologywepresentamoreelaborateanalysisonmicroarraydatathanformerresearchers.Themethodcanalsobeusedinotherfieldswithsimilarscenario.
简介:SNDisasphericalnon-magneticdetector,whichoperatedsince1996atVEPP-2Melectron-positroncolliderinNovosibirsk.NowVEPP-2McolliderisdismantledtobereplacedbyanewVEPP-2000machinewithhigherenergyandluminosity.TheSNDdetectorisalsoperformingupgradeofitssubsystemsincludingelectronics,andsoftware,ExpectedsubstantialgrowthofeventsdataflowrequiresradicalchangesintheDataAcquisition(DAQ)systemsoftware.ThispaperdescribestheSND2000softwarearchitecrureanditsprincipalcomponents.Firstthemaineventsflowprocessuingcomponentsareconsidered-thereadoutprocessandtheL3-triggerfarm.AfterprocessingbyL3theeventsflowiseitherloggedtotapeorfedtocalibrationandslowcontrolprocess.Usingauxiliarycontrolandservicesoftwarecomponents,whicharealsodescribed.performsthemanagementoftheseactivities.
简介:TheCDFcollaborationattheFermilabTevatronanalysesproton-antiprotoninteractionsatacenter-of=massenergyof2TeV.duringthethecolliderrunstartingthisyeartheexperimentexpectstorecord1Petabyteofdataandassociateddatasamples,TheDataHandling(DH)systemhasonlineandofflinecomponents.TheDHofflinecomponentprovidesaccesstothestoreddata,tostoredreconstructionoutput,tostoredMonte-Carlodatasamples,anduserowneddatasamples.Itservesmorethan450physicistsofthecollaboration.TheextrarequirementstotheofflinecomponentoftheDataHandlingsystemaresimplicityandconvenienceforusers.Morethan50millioneventsoftheCDFRunIIdatahavebeenalreadyprocessedusingthissystem.
简介:ThelongtermaccessibilityofitsdataisanimportantconcernoftheDELPHIcollaboration.Itisourassumptionthatthestorageofthedataitselfwillbeaminorissueduetotheprogressinstoragetechnologies.ThereforeDELPHIfocusesonareorganisationofthedata,whichshouldprovideaflexibleandcoherentframeworkforphysicsanalysisinthefuture.ThispaperdescribesthecurrentstatusoftheIDEA(ImprovedDElphiAnalysis)projectwhichwillensureusabilityofDELPHIdataforfuturegenerationsofphysicists.