Big data decentralization
jinwowo group will use blockchain technology to promote the legalization of big data business. The encryption of blockchain technology can ensure that the privacy of data sources can be better protected when big data is called, so as to eliminate the bad phenomenon of illegal reselling of big data and rebuild the rules of legal circulation and application in the data market.
please focus on the bold part:
Internet thinking, in the mobile Internet plus big data, cloud computing and other technology development background, the market, users, procts, enterprise value chain and even the whole business ecosystem to reconsider the way of thinking. P>
first put forward the Internet thinking is the founder of network company Robin Li. In a large-scale activity on the Internet, Robin Li first discussed the word "Internet thinking" when Robin Li explored the development issues with the boss and entrepreneur of traditional instries. He said that we entrepreneurs should have Internet thinking in the future. Maybe what you do is not Internet, but your way of thinking should graally think from the perspective of Internet. Now a few years later, this concept has been graally recognized by more and more entrepreneurs, even people from all walks of life and fields outside the enterprise. But the word "Internet thinking" has evolved into a number of different interpretations
< UL >
the way of thinking in the Internet era is not limited to Internet procts and Internet enterprises. The Internet here refers not only to desktop Internet or mobile Internet, but also pan Internet, because the future network form must span all kinds of terminal devices, such as desktop, notebook, tablet, mobile phone, watch, glasses, etc. Internet thinking is to rece the dimension, let the Internet instry take the initiative to integrate the real instry
How does Internet thinking come into being? Proctivity determines the relationship of proction. To a certain extent, the technical characteristics of the Internet will affect its logic at the commercial level. The unit of instrial society is tangible atom, while the basic medium of Internet world is intangible bit. This means that economics in the era of instrial civilization is a kind of scarcity economics, while economics in the era of Internet is a kind of abundance economics. According to Moore's law and other theories, the three basic elements of the Internet bandwidth, storage and server will be unlimited free. In the Internet economy, monopoly of proction, sales and communication will no longer be possible Moreover, a network Internet has no central node, it is not a hierarchical structure. Although different points have different weights, no point is absolutely authoritative. So the technical structure of the Internet determines its inner spirit, which is decentralized, distributed and equal. Equality is a very important basic principle of the Internet
in a network society, the value of an "indivial" and an "enterprise" is determined by the breadth and thickness of the connecting point. The wider and thicker your connection, the greater your value. This is also the basic feature of the pure information society. Your information content determines your value. So opening becomes a necessary means of survival. If you don't open up, you can't get more connections
Therefore, the Internet business model must be built on the basis of equality and openness, and Internet thinking must reflect the characteristics of equality and openness. Equality and openness mean democracy and humanization. In this sense, the Internet economy is a real people-oriented economy < UL >
in the era of agricultural civilization, the most important assets are land and farmers. In the instrial era, the most important assets are capital, machinery (machinery is solidified capital) and alienated people on the assembly line. In the early instrial age, the most important consideration was the alienated man, because man was also treated as a machine. People are just screws in the assembly line
in the era of knowledge economy, the core resources are data and knowledge workers, which Drucker said at the end of last century. Enterprise management will also move from the traditional multi-level to a more flat, more network, more ecological way. Let knowledgeworker truly create value and become the most important and needed breakthrough place for any organization and the whole society
blockchain is an important concept of bitcoin. It is essentially a decentralized database. At the same time, as the underlying technology of bitcoin, it is a series of data blocks generated by using cryptographic methods. Each data block contains a batch of bitcoin network transaction information, which is used to verify the effectiveness of its information (anti-counterfeiting) and generate the next block
blockchain is unified in the whole network, so it is logically centralized. From the perspective of architecture, blockchain is based on peer-to-peer network, so it is decentralized. From the perspective of governance, blockchain makes it difficult for a few people to control the whole system through consensus algorithm, so it is decentralized.
in the future, jinwowo will continue to tap the value of blockchain technology in the commercial field, give full play to the advantages of big data services, add value to user behavior, break the ice for the development of small and medium-sized enterprises, and build a real, efficient, safe and honest Internet community of destiny.
or when it is open source, there is a bug in 10 lines
the development of likelib public chain has the following stages: condensation stage, solid foundation (in the next 1-2 years), improvement of technical design documents, completion of basic mole code development, online main chain, continuous improvement of intelligent contract, multi chain parallel, cross chain consensus and other early functions, improvement of main chain, side face and surrounding ecology, including blockchain browser, light wallet and mobile wallet, Smart contract, virtual machine, compiler, development tools, multi language adaptation, etc. Establish, develop and improve open source community, start and promote more application access
in the integration stage, it will grow steadily (in the next 3-5 years), complete the implantation of more consensus moles, realize the self evolution of network, storage and other moles (support EB level data storage), form a standard technical solution system for docking applications in various instries, and explore a new ecosystem combining blockchain with big data, artificial intelligence and other fields. Form a mature open source community and establish application side chain on a large scale
in the sublimation stage, a technology platform integrating blockchain, big data and artificial intelligence will be established everywhere (in the next five years) to provide comprehensive solutions for the proction and operation needs of instry, agriculture and commerce. Form an open source community with the integration of blockchain, big data and artificial intelligence, and provide a comprehensive value docking and cooperation platform.
With the rapid development of human society, many people find that decentralization is a trend and also represents a new proction relationship. This is a new kind of proction relationship that is suitable for the business or business logic based on the highly developed and market-oriented human society and economy, equality and mutual trust. Since the decentralized trust mechanism blockchain has been established, many intermediaries will also face upgrading and innovation. For example, "Wall Street", a traditional medium which is essentially a financial intermediary, may soon develop into a new model
decentralization has changed more than one financial instry. In the consensus of China's excellent Internet company "Xunlei", science and technology is developing from centralization to decentralization. They are proud that their first P2SP download technology is a kind of decentralized technology. At that time, blockchain was not widely recognized. Xunlei believes that decentralized technology has many advantages. Its solution is light weight and low cost; It respects privacy and doesn't have an intermediate database to know everything; It accords with the development of society; It is a measure of environmental protection and sharing. In 2014, Xunlei made up its mind to do decentralized cloud computing, also known as shared computing, which is to distribute the computing needs to thousands of households and use the idle resources of users
such an attempt has got a very good market response, because the marginal cost of shared computing is lower than that of cloud computing, which can more effectively solve the social contradiction between the shortage of social computing resources and the high cost of computing, and rece the operating costs of enterprises, including Xiaomi, Aiqi and Xiongmao live broadcasting, which have become the customers of thunderbolt shared computing. In fact, the demand for computing in the current society is growing explosively. Whether it is artificial intelligence, big data, 4K, VR, the demand for network is higher and higher, the speed of computing is higher and higher, and the demand for speed is higher and higher. If you want to solve all the needs, you need to prepare sufficient computing resources. The player reward scheme is born to solve this problem
the significance of the player reward program is that in the shared computing ecosystem, Xunlei has joined the blockchain technology to share the bandwidth with the players through the cloud intelligent hardware Users of idle resources such as storage and computing power will issue the digital asset chain gram (original gamer coin) based on blockchain technology. Users participate in this plan for free, and they also voluntarily contribute idle computing resources to the society. Users actively contribute idle resources, Xunlei payment chain rewards users, Xunlei then packages and sells resources to enterprises, and a supply chain based on shared computing is completed. In this process, decentralized blockchain technology plays an important role
of course, complete decentralization lacks supervision, and there is a certain risk of being used. Therefore, the blockchain chosen by chaink is "alliance chain", not a completely decentralized public chain like bitcoin and Ethereum. Therefore, Xunlei still has the right of supervision. In order to rece and avoid the occurrence of malicious events of accounting nodes, and to ensure that users' transactions enter the block as soon as possible, Xunlei is more cautious in selecting accounting nodes. In the initial stage, Xunlei will choose its own servers with good network connectivity and stability, as well as its partners' servers with good network connectivity and stability, After the performance and security of the next generation of gamer cloud hardware are further improved, the gamer cloud node distributed in the user's family will be selected as the accounting node and constantly changed. At the same time, Xunlei united government actively cracked down on speculation, announced the firm no ICO, cracked down on third-party transactions, adopted the real name system, unlimited pre-sale activities and other means to resolutely curb the risk of speculation, so as to ensure the stability and sustainability of the player cloud and chain ecology
with the emergence of blockchain applications such as chaink, we can see that decentralized technology can make the instry no longer become so extreme, and all kinds of opportunities will burst out because of the introction of new mechanisms, which is of positive significance to the instry and the whole society
such an attractive salary is definitely what everyone wants to join. However, the condition for joining is to master certain skills. Based on the requirements of many big data companies, the statistics are as follows:
1
2. Skillfully use Hadoop, M / R, hive, storm and other development tools
3. Familiar with Linux commands and shell programming
4. Sensitive to data, good logical analysis ability, good communication skills and team spirit
5. Familiar with impala, Druid, mdrill, elasticsearch and other big data tools is preferred
according to the requirements of enterprises for big data engineers, the technologies you need to learn are as follows:
stage 1, big data foundation - Java language foundation
(1) Java language foundation
(2) HTML, CSS and JavaScript
(3) JavaWeb and database
stage 2, Linux & Hadoop ecosystem
linux system, Hadoop offline computing outline Distributed database HBase, data warehouse hive, data migration tool sqoop, flume distributed log framework
stage 3, distributed computing framework and spark & strom ecosystem
(1) distributed computing framework
python programming language, Scala programming language, spark big data processing, spark streaming big data processing, spark mlib machine learning, etc Calculation of spark graphx diagram, actual combat 1: recommendation system based on Spark (real project of a front-line company), actual combat 2: sina.com www.sina.com.cn
(2) storm technology architecture system
storm principle and foundation, message queue Kafka, redis tool, zookeeper detailed explanation, actual combat I: log alarm system project Actual combat 2: guess you like the actual combat of recommender system
stage 4: actual combat of big data projects (real projects of first-line companies)
data acquisition, data processing, data analysis, data presentation, data application
stage 5: big data analysis AI (artificial Intelligence)
data analysis work environment preparation & data analysis basis, data visualization, python machine learning
1 Python machine learning 2. Image recognition & neural network, natural language processing & social network processing, practical project: outdoor equipment recognition and analysis