云計算與下一代idc的架構(gòu)與運維

1、2012華東架構(gòu)師大會,演講主題：云計算與下一代IDC的架構(gòu)與運維,演講嘉賓：李志霄,Cloud Fundamentals,Infrastructure as a Service (IaaS): basic compute and storage resourcesOn-demand serversAmazon EC2, VMWare vCloudPlatform as a Service (PaaS): cloud appli

2、cation infrastructureOn-demand application-hosting environmentE.g. Google AppEngine, Salesforce.com, Windows Azure, AmazonSoftware as a Service (SaaS): cloud applicationsOn-demand applicationsE.g. GMail, Microsoft

3、Office Web Companions,今天的IT部署方式與時俱進了嗎？,,基于運算與知識的服務(wù)將成為社會化的服務(wù)（utility-水電氣）,今天許多CIO，CFO仍然在——投資昂貴的設(shè)備-服務(wù)器，路由器。磁盤（CAPEX）;等待一兩年的項目實施的周期;承擔項目開發(fā)和上線的風險;為維護系統(tǒng)，災(zāi)備而煩惱;缺乏彈性-業(yè)務(wù)需求變化造成設(shè)備，帶寬閑置（被投資人罵翻）或不足（被用戶罵翻）。,把大規(guī)模、分散的計算資源整合為可以按須提供

4、服務(wù)的計算資源，提高了IT設(shè)施的利用率，降低了成本和用戶使用門檻,The Benefits of the Cloud,The Cloud is about cheap, on-demand capacity,Eg Windows Azure,,Your options increase with the Cloud,,Extend application to the Cloud,Store data in the Cloud,Move

5、 application to the Cloud,Create new Cloud service,Combine Cloud services to create new sol’n.,,,,生態(tài)系統(tǒng)鳥瞰圖 –認識自己（Ecosystem）,,信息電網(wǎng),信息電器,信息電廠,Connected Device,3G/4G LTEADSL/WiFi/Femtocell/FTTX高速衛(wèi)星寬帶,數(shù)據(jù)中心 /IaaSSaaS/

6、PaaSXaaS,TIME云端產(chǎn)業(yè),,,,elecom,T,edia,ntertainment,數(shù)據(jù)中心也在向增值服務(wù)與時俱進Migration to Value Added Services,Colocation Model,Managed Services Model,ManagedHosting Model,CloudModel,CustomerServer,Mgmt,,IP BW,Colo,Po

7、wer,CustomerServer,,Install,test,Monitor,RH,IP BW,Colo,Power,Server,Storage,Consulting,Ops,Mgmt,Monitor,IP BW,IP VPN,Colo,Power,Utility Hosting,Server,Storage,Consulting,Ops,Mgmt,Monitor,IP BW,IP VPN,Colo,Powe

8、r,,21V Managed,,21V Managed,A Paradigm Shift 思維轉(zhuǎn)換,,今天的IT競爭已經(jīng)不是企業(yè)的競爭，也不是產(chǎn)品的競爭，而是進入了一場產(chǎn)業(yè)鏈競爭 （Wintel-8/2開放/封閉式，蘋果-99.9/0.1封閉/開放式）,,云計算產(chǎn)業(yè)正從傳統(tǒng)IT產(chǎn)業(yè)和互聯(lián)網(wǎng)產(chǎn)業(yè)中脫胎換骨，以全新的形態(tài)呈現(xiàn)在人們眼前,,云計算就是把廉價硬件（COTS）軟件化軟件服務(wù)化服務(wù)運營化運營規(guī)?；囊惶准夹g(shù)和業(yè)務(wù)模式,因

9、此我們有必要及早定位云計算產(chǎn)業(yè)鏈、布局關(guān)鍵環(huán)節(jié),,,,You Manage,Cloud Services,,,Most of Today’s Cloud IDC,True Cloud IDC,Example: Windows Azure Components,What a “Cloud OS” should be:,Cloud OS= OS for the data centerModel: Treat the data center

10、 as a machineHandles resource management, provisioning, and monitoringManages application lifecycleAllows developers to concentrate on business logicProvides shared pool of compute, disk and networkVirtualized stor

11、age, compute and networkIllusion of boundless resourcesProvides common building blocks for distributed applicationsReliable queuing, simple structured storage, RDBS storageApplication services like access control an

12、d connectivity,The “Heart and Soul” of Cloud OS--Fabric Controller (FC),The “kernel” of the cloud operating systemManages datacenter hardwareManages Windows Azure servicesFour main responsibilities:Datacenter resourc

13、e allocationDatacenter resource provisioningService lifecycle managementService health(fault, performance) managementInputs:Description of the hardware and network resources it will controlService model and binari

14、es for cloud applications,Windows Azure Fabric Controller I,Server Hardware,Windows Server,WindowsApp,SQLServer,DataCenter,Windows Azure,AzureApp,SQLAzure,Windows Kernel,FabricController,,Windows Azure Fabric Contro

15、ller,Modeling Cloud Applications,A cloud application is typically made up of different componentsFront end: e.g. load-balanced stateless web serversMiddle worker tier: e.g. order processing, encodingBackend storage: e

16、.g. SQL tables or filesMultiple instances of each for scalability and availability,,,There Are Three Ways to Get Started Using Windows Azure Compute:,Web Sites – Quickly and easily deploy sites to the cloud with suppor

17、t for multiple frameworks and popular open source applications including WordPress, Drupal, Joomla! and Umbraco.,Virtual Machines – Instantly run your existing applications and infrastructure in a VHD image. You reta

18、in full control to configure and maintain the image. Capture some benefits of the cloud including load balancing and failover.,Cloud Services – Capture the full benefits of the cloud that quickly scale up or down.

19、Infrastructure management is all done by Microsoft, so you can focus your resources on building the best app.,,,Windows Azure Cloud Services,Web Role,Worker Role,Cloud Services come in two Flavors:,,A place for your app

20、lication code to run…Web role is pre-configured with IISWorker role is for backend, async codeYou package your code/artifacts and Windows Azure deploys and manages it for you automatically,,,,,,,Windows Azure Virtual

21、 Machines,Blob Storage,Cloud,,Management Portal,Scripting (Windows, Linux and Mac),REST API(for service mgmt),Getting Started,Select Image and VM Size,New Disk Persisted in Storage,Boot VM from New Disk,,,,The Windows

22、Azure SDK provides several APIs for programming in the Windows Azure environmentThe Windows Azure Service Management API is a REST API for managing your storage accounts and service deployments . 服務(wù)管理 API是一個REST API, 可

23、以管理Windows Azure存儲賬戶和托管部署服務(wù)。It provides programmatic access to much of the functionality available through the Management Portal. All API operations are performed over SSL and mutually authenticated using X.509 v3 cert

24、ificates. 所有API操作均需要進行基于SSL的身份驗證和使用X.509 v3的證書.The management service may be accessed from within a service running in Windows Azure, or directly over the Internet from any application that can send an HTTPS request and

25、receive an HTTPS response.。,REST API在Azure兩種服務(wù)類型的應(yīng)用Storage Accounts: 提供訪問Windows Azure Blob, Queue, and Table 的服務(wù). 可以實現(xiàn)管理現(xiàn)有的Storage Account，實現(xiàn)在訂閱清單包含存儲賬戶信息；返回存儲賬戶屬性；重新生成密鑰。Hosted Services: 提供在Azure環(huán)境中部署 Web Role; Wo

26、rk Role ;VM Role。 可以創(chuàng)建、刪除部署；返回一個托管服務(wù)的屬性；更新升級，重啟，和管理已經(jīng)部署的服務(wù)。,REST API,Windows Azure Storage Service: eg Create Storage Account POSThttps://management.core.windows.net//services/storageservices,,RESTAPI(POST，GET，PUT或DEL

27、ETE),Load Balance,Blob,Queue,Table,REST(Representational State Transfer),,Windows Azure Web Sites,Quickly and easily deploy sites to a highly scalable cloud environment with the frameworks and open source apps of your ch

28、oice using Windows Azure Web Sites,Supports multiple frameworks (ASP.NET, Classic ASP, PHP, Node.js)Pick from popular Open Source apps Pick your DB (SQL Database, MySQL)Choose your tools (Visual Studio, Git(一個開源的分

29、布式版本控制系統(tǒng)), FTP, WebMatrix)Build on any platform (Windows, Mac, Linux),,,,Supported Deployment Protocols,,,,filename.cspkg + filename.cscfg,Application Deployed,,,VHD,XML,,Storage(URL),,Fabric Controller,,HostOS Agent,,

30、GuestOS Agent,,Setting Load balance & DNS,在Windows Azure上建一個免費的網(wǎng)站,在Windows Azure上建一個免費的網(wǎng)站時間:2012-07-16 19:46來源:風信網(wǎng) 作者:末信 點擊:257次 我要評論 -如果你想建立一個低成本的網(wǎng)站但是又具有極好的擴展能力能滿足業(yè)務(wù)和流量增長的需求， 或者 你想快速的建一個免費的網(wǎng)站，同時又有保障網(wǎng)站能穩(wěn)定安全的運行，那么微

31、軟的Widnows Azure的websites新功能就能滿足要求。如果我是一個剛起步不久的公司，或者我想做一個個人網(wǎng)站，我覺得Websites無疑是一個最佳的選擇。Window Azure 在今年六月的IaaS預(yù)覽版本里公布了Websites的新功能，用戶可以在Windows Azure上建十個免費12個月的網(wǎng)站（是不是對現(xiàn)在的一些網(wǎng)站托管很有壓力？），主要的優(yōu)點：快速便捷- 用戶可以容易地輕點幾下鼠標，就能建立一個網(wǎng)站，免去

32、網(wǎng)站托管和域名申請等繁瑣的步驟多種開發(fā)語言和平臺的支持 – websites支持ASP.NET, 傳統(tǒng)的ASP, PHP, Node.js，支持Windows, Mac, Linux，支持SQL Server ,SQL Azure, MySQL的數(shù)據(jù)庫優(yōu)秀的可擴展性-在Azure上建網(wǎng)站可以充分利用到Azure的可擴展性的能力，隨著網(wǎng)站流量的增加，可以隨時增加資源來支持網(wǎng)站原文出自【風信網(wǎng)】，轉(zhuǎn)載請保留原文鏈接：http:

33、//www.ithov.com/server/118212.shtml,The Windows Azure Service Model,A Windows Azure application is called a “service”Definition informationConfiguration informationAt least one “role”Roles are like DLLs in the servic

34、e “process”Collection of code with an entry point that runs in its own virtual machineThere are currently three role types:Web Role: IIS7 and ASP.NET in Windows Azure-supplied OSWorker Role: arbitrary code in Windows

35、 Azure-supplied OSVM Role: uploaded VHD with customer-supplied OS,Windows Azure offers multiple ways to manage your data in the cloud. SQL Database, formerly known as SQL Azure Database, enables you to rapidly create,

36、scale and extend applications in the cloud using familiar tools and skills.,,,Data Management are a set of managed services having a 99.9% monthly SLA,SQL Database also includes features that enable easy migration, expor

37、t and ongoing synchronization through SQL Data Sync of on-premises SQL Server databases with Windows Azure databases.,Tables offer manual, key-based access to un-schematized data at a low cost for applications with simpl

38、e data access needs. Blobs provide inexpensive storage of video, audio and images.,SQL Database,Cloud relational database based on SQL Server engineUse same tools, data access frameworks, T-SQL based languageGlobal da

39、tacentersHigh Availability & RedundancyReads are completed at the primaryWrites are replicated to a quorum of secondaries,Single LogicalDatabase,Multiple PhysicalReplicas,Single Primary,Multiple Secondaries,Repl

40、ica 1,Replica 2,Replica 3,,,,,,,,,,,SQL database,On-Premises,Cloud,Scale-out via multiple copies of dataE.g. Separate reporting & OLTP workloads; multiple Web sites,Geo-located web applicationsUse with Windows Azu

41、re Traffic Manager,Hybrid applications; one-way publish or two-way sharing,Multiple locations (e.g. branch office, retail offices); share data between locations and/or aggregate data in cloud,SQL Server,Application,,SQL

42、 Server,Application,,,,,,,SQL Data Sync (easier to access,security, compliance, DR, etc.),,,,SQL database,SQLAzure,,,,,,,SQL Azure DB,DBMS,Azure Sync,TDS(Tabular Data Stream) protocol,Reporting,Two kinds of data sync,Ex

43、tend your network into the cloudTreat your Windows Azure services as if they are on your own corporate network.Enables services in Azure (e.g. SQL Database) to use services on-premise (e.g. Active Directory) direct

44、ly.,Increase performance and availability of servicesRedirect user to best/closest deployment.Redirect traffic to another deployment based on availability.Traffic is distributed equally to all cloud services.,,,Win

45、dows Azure Networking,,,,ConnectFor developersDesigned for developers so it is simple to setup, easy to manage and can be rapidly provisioned,,,,,,,,Subnets in Windows Azure,,,,Virtual NetworkFor network administr

46、atorsProvides network admins the control to setup subnets in the Cloud and manage them as extensions of on-premise datacenters,Windows Azure Networking,,,,Windows Azure Traffic Manager,Load balance user traffic acros

47、s cloud services running in same or different datacenters to build globally available, high performing apps,DNS based traffic management based on policies: Performance, Round- robin, Failover,Improve app performance by s

48、erving user requests with services ‘closest’ to them,Improve app availability by automatically failing over when a service goes down,,,,traffic manager,Windows Azure Active Directory is a modern cloud service providing i

49、dentity management and access control capabilities to cloud applications, whether those are Windows Azure applications, Microsoft Office 365, Dynamics CRM Online, Windows Intune or other 3rd party cloud services.,Easily

50、 integrate Live ID, Facebook, Yahoo, Google, & Active Directory for application single sign-on.,Support for industry standards and existing .NET APIs.,CDN,caching,integration,HPC,,,,,,,,A modern cloud service provid

51、ing identity management and access control capabilities to cloud applications,,Windows Azure Active Directory (Identity & Security),,,,,,,,3rd Party Apps,,Microsoft Apps,A modern cloud service providing identity ma

52、nagement and access control capabilities to cloud applications (通過對諸如WRAP和SAML之類的標準協(xié)議的支持,ACS will perform sign-in with any OpenID 2.0 identity provider-Google, Facebook, Yahoo),CDN,caching,integration,HPC,,,,,,,,,,Feder

53、ation Trust,,,,ACS V2,Media Services provide a scalable and reliable infrastructure allowing you to focus on your core business and the valuable features that differentiate your products.,Windows Azure Media Services are

54、 easy to use, flexible, and provide cost-effective and fully customized solutions that can create, manage, and distribute content for all the devices and platforms you care about.,,,,,,,,Media Services enable Content Com

55、panies and Solution Providers to build end-to-end media workflows on Windows Azure.,Windows Azure Media Services,,,,,,,,Media Services enable Content Companies and Solution Providers to build end-to-end media workflows o

56、n Windows Azure.,What PaaS IDC is:,Provides Platform as a ServiceApplication Platform in the CloudProvides:ComputeWeb, Worker & VM RoleStorageBlob, Table, Queue & RDBS Server Application FabricService Bus

57、, Access Control, Cache, Integration,,CDN,caching,HPC,integration,,,Datacenter Architecture,Nodes,TOR,,,LB,,LB,Agg,PDU,,,LB,,LB,Agg,,,LB,,LB,Agg,,,LB,,LB,Agg,,,LB,,LB,Agg,,,LB,,LB,Agg,Racks,,,Datacenter Routers,Aggregati

58、on Routers andLoad Balancers,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TOR,PDU,Nodes,TO

59、R,PDU,…,…,…,…,…,…,Top of RackSwitches,Power Distribution Units,,Fault Domain,Hardware & Network Topology,,High Availability: Fault Domains,Purpose: Avoid single points of failuresUnit of failure based on data cent

60、er topologyE.g. top-of-rack switch on a rack of machinesWindows Azure considers fault domains when allocating service rolesE.g. don’t put all roles in same rack,OSS(Equipment(network, server, storage) and SW health mo

61、nitoring and control)-necessary for any kind of cloud,BSS(online/offline sales, billing/finance, marketing BI, CC, ICP Compliance, etc.)-necessary for public cloud,Challenges-Security and Interoperability,Security Confi

62、dentialityFree from attacks Service Level AgreementSLA must assure QoS (quality-of-service), e.g., service response timeInteroperabilityEnsure a cloud service user can move from one cloud service to another,45,,Sou

63、rce:Lin, G., Fu, D., Zhu, J. and Dasmalchi, G., “Cloud Computing: IT as a Service,” IT Pro March/April 2009,,IT 部署邊界的演變:基礎(chǔ)設(shè)施虛擬化/服務(wù)管理標準化、自動化-四大板塊雖會有消長，但都會繼續(xù)存在，尤其是核心應(yīng)用-可定制性， 合規(guī)要求，業(yè)務(wù)流程引擎，業(yè)務(wù)規(guī)則引擎（通用云平臺面向企業(yè)應(yīng)用的短板）,企業(yè)內(nèi)共享應(yīng)用-不同應(yīng)用

64、可以共享資源,企業(yè)內(nèi)核心應(yīng)用-不同應(yīng)用所需的資源均保持獨立,增值型云托管Cloud Hosting-不同客戶的不同應(yīng)用可以共享資源,傳統(tǒng)托管/租賃托管，多用戶數(shù)據(jù)中心Colocation，Managed Hosting-資源為客戶擁有或?qū)Ｓ?,,,,Video ConferencingEmailIM開發(fā)測試存儲,ERPSCMCRMEmailSearchIdentity/S

65、ecurity存儲,FinanceHR企業(yè)機密政務(wù)內(nèi)網(wǎng)存儲,eMailSearchERPCRMSCM存儲,,,,互操作性,,,,,,,共享的面向服務(wù)體系結(jié)構(gòu)（如http, XML, SOAP, WSDL, UDDI）,,,,文檔,,Service Bus,,,What is it ?,Extension to the familiar WCF binding model SOAP/HTTP SOAP/TCP

66、HTTPSimple HTTP APIs for service Management Service Registry (Atom Publishing Protocol) Message Buffer(REST)Fully integrated with Access Control Service,,,Service Bus,Exchange messages between loosely coupled appl

67、ications Network send/receive from any internet connected deviceTraverse NAT /FirewallMessage buffering for loosely connected applicationsFacilitate direct peer-to-peer connection,Service Bus,App 1,App 2,Send,Receive

68、,Send,Receive,,,Service Bus,Service Bus 可以用于將本地的服務(wù)暴露給Internet。大多數(shù)企業(yè)都擁有自己的局域網(wǎng)，為了解決IP地址不足的問題通常都設(shè)置了NAT，因此每臺server對外都沒有一個確定的地址。處于安全性考慮，防火墻往往都限制了大多數(shù)的端口。這就使得要在Internet上訪問部署在本地的服務(wù)變得相當困難。,,,Service Bus,Service Bus 正是為了解決這一問題而產(chǎn)生的

69、。Service Bus作為一個中間人，你的服務(wù)和客戶端全都作為Service Bus的客戶端與之進行交流。因為Service Bus不存在NAT問題，所以你的服務(wù)和客戶端都很方便地能與之通信。Service Bus在最極端的場合下只需要你的服務(wù)器暴露out bound 的80或443端口，換句話說，也就是你的服務(wù)器能夠以HTTP（S）協(xié)議訪問Internet。只要這樣，你的服務(wù)器就能連上Service Bus。因此，它對防火墻的要求可