Secure and Scalable LAMP Service Architecture in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Secure+and+Scalable+LAMP+Servi...LAMP means Linux + Apache + MySQL + PHP that is commonly used to develop web service for Start-ups that does not require paying license fee, because all of technologies are from open source.Following architecture diagram shows a manageable, secure, scalable, high performance, efficient, elastic, high available, fault tolerant and recoverable. Followings are the assumptions to design aboveService is designed for web service based on LAMP (Linux, Apache, MySQL, PHP)Service architecture is based on 2-Tier ar...
Tag: Apache, AWS, Fault Tolerant, High Availablility, LAMP, LAMP Architecture, LAMP Service Architecture, Large Scale Service Architecture, Linux, MySQL, PHP, Service Architecture, Start-ups
Enterprise Data Lake Architecture in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Enterprise+Data+Lake+Architect...Enterprise Data Lake Architectural Diagram
Tag: AWS, Big Data, Data Lake, Data Lake Architectural Diagram, Service Architecture
AWS Cost Calculator for estimating your required monthly budget - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/AWS+Cost+Calculator+for+estima...Whenever you design your software architecture based on AWS, you may need to know how must cost it will consume while serving your service - following service will help you to get your estimated cost.ServicesURLsNotesAWS Simple Monthly Calculatorhttps://calculator.s3.amazonaws.com/index.htmlSuper simple and easy to use if you are familiar with AWS compontents. You can simply select region, compute instances, storage, expected run time, IP and etc.AWS Pricing Calculator https://calculator.aws/#/Calculator ...
Tag: AWS, AWS Cost, AWS Cost Calculator
Content Distribution for VOD streaming services in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Content+Distribution+for+VOD+s...Below architectural diagram shows how to distribute video content to CDN (Amazon CloudFront) in AWS. The concept is simple:1) AWS Lamda monitor Amazon S3 folder if there is anything need to be converted for VOD streaming2) "AWS Elemental MediaConvert" transcodes the original file in adaptive streaming format like HLS/DASH3) CloudWatch monitors if that transcoding is successfully done or not and triggers AWS Lambda for publishing to S3 if everything is done as planned.4) TV can enjoy VOD content through Am...
Tag: Amazon CloudFront, Amazon S3, AWS, AWS CDN, AWS Elemental MediaConvert, AWS Lamda, CDN, CMS, Content Distribution, Content Management System, OTT, OTT Architecture, Over The Top, Service Architecture, VOD Streaming
Common Django architecture with uWSGI, NGiNX on CentOS 7 - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Common+Django+architecture+wit...NGiNX and uWSGI provides a great combination for Django-based web service on CentOS 7. NGiNX is open source software for web serving, reverse proxying, caching, load balancing, media streaming, and more. We use uWSGI to integrate with NGiNX, because NGiNX does not support WSGI - uWSGI is a web server supports WSGI is used to forward requests from a web Server (such as Apache or NGINX) to a backend Python web application or framework. The below diagram is a common web service architecture based on Django, ...
Tag: Apache, Architecture, CentOS 7, Common Django Architecture, Django, Django Architecture, nginx, Python, Service Architecture, uWSGI, WSGI
online text editor - collabedit
https://collabedit.com/Collabedit is an online text editor that allows real-time collaboration supporting various programming languages such as c, c++, java, javascript, python, php and etc.
Tag: coding test, collaborative coding tool, free coding testing tool, java, javascript, php, python, test, text editor, 코딩, 코딩 테스트, 코딩테스트
Financial services grid computing in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Financial+services+grid+comput...Financial services grid computing on the cloud provides dynamic scalability and elasticity for operation when compute jobs are required, and utilizing services for aggregation that simplify the development of grid software.The key point of this architecture is dividing roles and responsibilitiesCorporate data center manage customer-sensitive informationThe other part manage other roles like high performance computing, user experience stuffs without any restrictions in privacy information. For your informa...
Tag: AWS, Corporate Data Center, Customer-Sensitive Information, Dynamic Scalability, Financial Service, Grid Computing, High Performance Computing, Privacy Information, Service Architecture
AWS VPC Setup Steps - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/AWS+VPC+Setup+StepsNot like architectural diagram, setting up a VPC environment is not that simple, because it requires to click lots of menus in AWS Console after creating that VPC. Based on my experience, that is not easy to remember, because it's rarely happening process and its complex clicking labors. So I think easy video guide is good enough.Followings are overall steps associated with VPCSTEP 1. Create two Elastic IP addresses for connectionhttps://ap-northeast-2.console.aws.amazon.com/ec2/v2/home?region=ap-northeas...
Tag: AWS, AWS Console, Elastic IP Address, VPC
Media sharing service architecture in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Media+sharing+service+architec...Media sharing is one of the hottest markets on the Internet. Customers have a staggering appetite for placing photos and videos on social networking sites, and for sharing their media in custom online photo albums.The growing popularity of media sharing means scaling problems for site owners, who face ever-increasing storage and bandwidth requirements and increased go-to-market pressure to deliver faster than the competition.Since most businesses today have limited manpower, budget, and data center space,...
Tag: AWS, Custom Online Photo Albums, Media Sharing, Media Sharing Service Architecture, Popularity, Service Architecture, Social Networking
Disaster recovery solution in AWS for local applications - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Disaster+recovery+solution+in+...Disaster recovery is about preparing for an recovering from any event that has a negative impact on your IT systems. A typical approach involves duplicating infrastructure to ensure the availability of spare capacity in the event of a disaster.For a disaster recovery solution, this results in significant cost savings. The following diagram shows an example of a disaster recovery setup for a local application. AWS Storage Gatway is a service connection an on-premises software appliance with cloud-based sto...
Tag: Amazon EC2, Amazon S3, AWS, Backup, Disaster Recovery, Disaster Recovery Setup, Duplicating Infrastructure, Service Architecture
Time series processing architecture in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Time+series+processing+archite...When data arrives as a succession of regular measurements, it is known as time series information. Processing of time series information poses systems scaling challenges that the elasticity of AWS services is uniquely positioned to address.This elasticity is achieved by using Auto Scaling groups for ingest processing, AWS Data Pipeline for intersystem data orchestration, and Amazon Redshift for potentially massive-scale analysis. Key architectural throttle points involving Amazon SQS for sensor message bu...
Tag: Amazon SQS, Auto Scaling Group, AWS, AWS Data Pipeline, Service Architecture, Time Series Information
Synchronous online gaming architecutre in AWS - Highly Available, Scalable & Elastic to support Millions of Players - Knowledge Base - QSOK - Knowledge base
https://qsok.com/pages/viewpage.action?pageId=42827804The below architecture is intended for online mobile & games. These workloads are a natural fit for running on Amazon Web Services, due to unexpected traffic patterns & high demaning request rates. From above diagram, Amazon Elasticache is for Redis that provides fully managed solution that enhances robustness and reduces the cost of installing, operating & maintaining a highly available & scalable Redis cluster. Leverage Multi-AZ Elasticache in your game to provide automated disaster recovery & a scalabl...
Tag: Amazon Elasticache, AWS, Disaster Recovery, Gaming Architecture, High Availability, Multi Availability Zones, Redis Cluster, Service Architecture
Product Marketing & Recommendation Architecture in AWS for e-commerce website - Knowledge Base - QSOK - Knowledge base
https://qsok.com/pages/viewpage.action?pageId=45514753Product Marketing & Recommendation is one of features that online service websites has to create more user engagement, so online company can try something new together with users. An Amazon Relational Databases Services (Amazon RDS) Read Replica of customer and order databases is used by Amazon Elastic MapReduce(Amazon EMR) to compute user profiles and by Amazon Simple Email Service (Amazon SES) to send targeted marketing emails to customers.Log files produced by the e-commerce web front end have been sto...
Tag: Amazon Elastic Map Reduce, Amazon EMR, Amazon RDS, Amazon Relational Database Service, Amazon SES, Amazon Simple Email Service, AWS, Product Marketing, Read Replica, Recommendation, Recommendation Architecture, Service Architecture
File synchronization service architecture in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/File+synchronization+service+a...Given the straightforward, stateless client-server architecture in which web services are viewed as resources and can be identified by their URLs, development teams are free to create file sharing and syncing applications for their departments, for enterprises, or for consumers directly.This diagram represents the core architecture of a scalable and cost-effective file sharing and synchronization platform, using Amazon Web Services #Description1The file synchronization service endpoint consists of an Elas...
Tag: File Synchronization, Service Architecture, Stateless Client-Server Architecture
Batch processing composed of job manager, job store and worker based on AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Batch+processing+composed+of+j...Batch processing on AWS allows for the on-demand provisioning of a multi-part job processing architecture that can be used for instantaneous or delayed deployment of a heterogeneous, scalable "grid" of worker nodes that can quickly crunch through large batch oriented applications in place today that can leverage this style of on-demand processing, including claims processing, large scale transformation, media transcoding and multi-part data processing work.Batch processing architectures are often synonymo...
Tag: Amazon RDS, Amazon Relational Database Service, Amazon Simple Queue Service, Amazon SimpleDB, Amazon SQS, AWS, AWS S3, AWS Simple Storage Service, EC2, Service Architecture
Large scale computing based on huge data sets in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Large+scale+computing+based+on...These scenarios involve huge data sets collected from scientific equipment, measurement device, or other compute jobs. After collection, these data sets need to be analyzed by large-scale compute jobs to generate result data sets. Ideally, results will be available as soon as the data is collected. Often, these results are then made available to a larger audience. awsaws-architecturefuseebsec2s3snapshots Overview Content Tools Powered by 8.0.3 Printed by Atlassian Confluence 8.0.3 {"serverDuration": 134, ...
Tag: AWS, Large Scale Computing, Large Scale Service, Service Architecture
Live streaming / Static Content & Media Service based on AWS
https://qsok.com/pages/viewpage.action?pageId=34799656AWS provides a suite of services specifically tailored to deliver high-performance media serving. Each service features pay as you go pricing on an elastic infrastructure - meaning that you can scale up and down according to your demand curve while paying for only the resources you use. BEcause this infrastructure is programmable, it can react quickly. #Description1Simple and Secure - This reference architecture uses Amazon Simple Storage Service (S3) to host static content on the web. Amazon S3 is highly...
Tag: Amazon Simple Storage Service, AWS, CMS, Content Management System, Content Service Architecture, Live Streaming Architecture, Media Service Architecture, OTT Architecture, Service Architecture
Fault Tolerance & High Availability based on multi Availability zones in AWS - Knowledge Base - QSOK - Knowledge base
https://qsok.com/pages/viewpage.action?pageId=38207489Most of the higher-level services, such as Amazon Simple Storage Service(S3), Amazon SimpleDB, Amazon Simple Queue Service (SQS), and Amazon Elastic Load Balancing (ELB), have been built with fault tolerance and high availability in mind. Service that provide basic infrastructure, such as Amazon Elastic Compute Cloud (EC2) and Amazon Elastic Block Store (EBS), provide specific features, such as availability zones, elastic IP address, and snapshots, that a fault-tolerant and high available system must take...
Tag: Amazon EBS, Amazon EC2, Amazon Elastic Block Sotre, Amazon Elastic Compute Cloud, Amazon Elastic Load Balancing, Amazon ELB, Amazon Simple Queue Service, Amazon SQS, Availability Zones, AWS, Elastic IP Address, Fault Tolerance, Service Architecture
"502 Bad Gateway" Error easy to happen at the combination of nginx and node.js in AWS Elastic Beanstalk - Knowledge Base - QSOK - Knowledge base
https://qsok.com/pages/viewpage.action?pageId=238289793Elastic Beanstalk is a Platform as a Service (PaaS) offered by AWS that simplifies the deployment and management of applications. It supports various programming languages, frameworks, and services. Nginx, on the other hand, is a popular web server and rever...
Tag: 502 Bad Gateway, AWS, AWS Elastic Beanstalk, AWS Web Server Memory Full, Elastic Beanstalk, nginx, node.js, Server Memory Full, Site Reliability Engineering, SRE, Web Server Memory Full
test preg_replace online - regular expression PHP functions - functions-online
https://www.functions-online.com/preg_replace.htmlTest and run preg_replace online in your browser. Searches $subject for matches to $pattern and replaces them with $replacement.
Tag: function, pattern, php, preg_replace, regular expression, replace, search, string
Image Moderation Chatbot - a serverless chatbot on AWS that monitors chat channels and removes images suggestive or explicit image - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Image+Moderation+Chatbot+-+a+s...The below architecture shows you how to build a serverless chatbot on AWS that monitors your chat channels and removes images containing suggestive or explicit content. #Description1A user posts a message containing an image to a chat app channel that's monitored by a chatbot.2The chat app posts the event to an Amazon API Gateway API for the chatbot.3The chatbot validates the event. This event triggers an AWS Lambda function that downloads the image.4Amazon Rekognition's image recognition feature checks t...
Tag: AWS, AWS Lambda, Chatbot Architecture, Image Moderation Chatbot, Service Architecture
Web Application Hosting provides the reliable, scalable, secure, and high-performance infrastructure - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Web+Application+Hosting+provid...High available and scalable web hosting can be complex and expensive. Dense peak periods and wild swing in traffic patterns result in low utilization of expensive hardware. Amazon Web Services provides the reliable, scalable, secure, and high-performance infrastructure required for web applications while enabling an elastic, scale-out and scale-down infrastructure to match IT costs in real time as customer traffic fluctuates. #Description1The user's DNS requests are served by Amazon Route 53, a highly ava...
Tag: Amazon Route 53, AWS, DNS, DNS Request, Domain Name Service, High Availability, Service Architecture
Check incomplete multipart uploads if AWS S3 storage size is abnormally big huge compared to the origin storage - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Check+incomplete+multipart+upl...You should check incomplete multipart uploads if your Metrics in the S3 Management Console shows larger size than you actually use. In my case, I found the total size of S3 bucket was 180TB, but actually size I uploaded based on the origin storage was 40TB. I tried to compare all the files one by one, but haven't found any difference. I learned AWS S3 keeps incomplete multipart uploads constantly and that won't be deleted as long as user does not make any actions. This is something unusual architecture I ...
Tag: AWS, AWS S3, AWS S3 Cost Optimization, AWS S3 Multipart Upload Failure Cleanup, AWS S3 Unused Data, Multipart Upload Failure, Multipart Uploads, S3 Bucket, S3 Incomplete Multipart Uploads, S3 Multipart Uploads
Web front-end architecture in AWS for e-commerce website - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Web+front-end+architecture+in+...Maintaining an e-commerce website with a large product catalog and global customer base can be challenging. The catalog should be searchable, and individual product pages should contain a rich information set that includes, for example, images, a PDF manual, and customer reviews.Customers want to find the products they are interested in quickly, and they expect pages to load quickly. Worldwide customers want to be able to make purchase at any time, so the website should be highly available. Meeting these ...
Tag: AWS, Front-end Architecture, High Availability, Large Scale Service Architecture, Service Architecture
Large scale messenger service architecture in AWS - Slack case study - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Large+scale+messenger+service+...Below slack architecture shows how to compose large scale messenger service based in AWS.Slack has two different communication channels: one for web and API channels and the other one is web sockets for real-time messaging.Slack uses multi availability zones for fault-tolerant service.Content storage has user message including media files, and that is directly delivered to Apache solr and Message server. awsaws-architectureslack Overview Content Tools Powered by 8.0.3 Printed by Atlassian Confluence 8.0.3...
Tag: AWS, Content Storage, Falult-Tolerant Service, Messenger Architecture, Multi Availability Zones, Service Architecture, Slack, Slack Architecture
Checkout service architecture in AWS for e-commerce website - Knowledge Base - QSOK - Knowledge base
https://qsok.com/display/KB/Checkout+service+architecture+...Managing the checkout process involves many steps, which have to be coordinated. Some steps such as credit card transactions, are subject to specific regulatory requirements. Other parts of the process involve manual labor, such as picking, packing, and shipping items from a warehouse.Customers may expect their private data, such as their purchase history and their credit card information, to be managed on a secure infrastructure and application stack.AWS has archived multiple security certificate relevan...
Tag: AWS, Checkout Process, Credit Card Transaction, Multiple Security Certificate, Secure Infrastructure, Service Architecture
Page: 1