2017 End-year Recap

距离要起床去机场还不到2个小时了。实在是辗转难眠,就起床开始写今年的倒数第二篇博客了。如果我在飞机上能读完那本书的话,还是会有一篇book review的。

先贴上2016年的回顾吧。毕竟格式是要保持一致的。

2017年回顾

上来先做个工作报告,回顾一下16年展望中的工作进展:

  • 博客数量至少100篇!

粗略数了数,17年目前为止总共写了62篇博客。其中技术类44篇更新在我的个人主页上。虽然没有完成既定的目标,但是我个人对这个数量还是比较满意的。年初的时候就基本发现1年写100篇博客其实还是不现实的。如果在这个数量前加个“有质量”的定语,那就更加不可能。“有质量”仅仅是指对我个人来说。技术博客9月份以前由于工作原因时间比较充分,所以还是可以好好看看书,然后写写的。但是到9月份的时候就有灌水之嫌了。所以,我就果断作罢,停止技术博客更新了。希望回国冬假期间能补上几篇。Wordpress的博客这一年来还是坚持每月至少更新一篇,整体质量还算说得过去,只有11月份灌水了一下,这里作为半吊子作家自我检讨一下。博客的灌水究其原因还是时间不够。随着开始硕士学习,课程强度使得我没时间沉淀。每天都在张着嘴,被老师拿各种新东西往里揣。现在感觉有点消化不良,希望冬假能沉淀沉淀。

  • 体脂比降到15%以下,体重降到70kg

看到这个是老泪纵横。在国内控制的可以叫做胜利在望,但是出来了就可以叫做惨不忍睹了。最好记录是72.6公斤,12%体脂比。主要出来检讨一下在国外这几个月骄奢淫逸的罪行。首先没弄个体重秤是最大的问题原因。果然没有数字的直接刺激,就很难评估每次运动的直接成果。其次就是吃了。最开始吃还是克制了一些,但是后来就非常放飞了。10月底开始我家来了个重要客人来我这入伙,那真是变成了想怎么吃就怎么吃了。一顿饭不仅要弄个2,3个蔬菜,连肉大部分时间都是既有白肉也有红肉。每次蒸米饭,我的手抓个3把就差不多了。但是由于客人实在太过尊贵,就抓个4,5把了。米饭真是个好东西。亚马逊19.99一大袋便宜不说,吃起来特别管饱。每次两个人坐在椅子上,互相看着对方拍着肚皮的样子,一种幸福感与安全感混杂的情绪就油然而生了。现在我做饭口碑算是小有建立起来了,至少在那位不能说名字的客人面前,我做的饭是属于管够并且“多搁点盐就是餐馆水平”的了。现在和我室友,以及那位客人相约减肥,为此我室友还搞了个体重秤。希望能如愿。

  • 看书频率要达到这位的速度

这个又是罪过了,完全没有达到预期。如果把全年以出国日期8月5号作为切割点的话,两段时间各自出现了一些问题。出国前看书偏细致,算法书逢题比作,看的实在是过于精细了一点。同时,自己文学类书籍看过一些,但是频率还是不及。出国后看书效率明显提升。这个主要得益于跳着看这个方法。 这里非常感谢Prof. Dana Ballard教的Machine Learning以及其他courses的老师们,自学成为主要学习手段。疯狂的project进度逼迫着我这个完美主义者向能用就行主义者的进化。看一本书直接就看最相关的章节,所有背景知识都是后补,并且如果又不理解的但又不影响阅读的,就画个标记搁置起来后边再看。意识到一本书可以看多遍的道理,所以第一遍读时的贪欲就少了很多,就不求每个点都读懂了。是的,写这段话的时候,我脑海里浮现的书名就是PRML。但是,一本书没有看完大部分章节终究还是不能说看过的,所以8月份后问题主要出现在时间不够上边。介于未来几年希望能读完PhD的我来说,状况可能改善不会太大。

  • 每读一本书都要写book review!

这个做的还是不错的。因为毕竟真正读完的就没有几本而且都集中在上班时期,所以每本读完的书都写过book review了。

  • 有所学校能收了我!

这个愿望算是实现了。感谢主。我来到了UT-Austin!

从2016年的展望来看,5个点真正完成的了只有最后两个,完成率40%,只能说一般。但是从2017年整体来看,我还是比较满意的。适应了从职场人到学生的转变,虽然第一学期的Graduate school非常难熬,但是我还是非常高兴自己能挺了下来。希望新的一年里能继续加油。

2018年展望

  • 向下扎根,向上结果

其实这是教会2018年要交通的主题。结合自己来看就是希望自己能够更加的了解神,接近神,信靠神。教会里属灵前辈讲男人是头。17年的第一学期主要参加的就是团契和主日了。祷告会一次也没有参加过,甚是惭愧。重要的客人这方面已经积累了10多年了,要超越不容易,但是还是要做。具体来说,18年希望内心得刚强。有的时候我深深佩服我这位客人。总觉得内心是刚强的,尤其在美国,在外旅行的时候。要向她学习。这点我觉得解决问题的关键还是在主那里。也许主让我和这位客人相遇就是想去除我内心上的软弱呢?我还是非常相信这点的。

  • 找到实习或者署研

这点其实是老生常谈的问题。研究方向成为了17年一个贯穿始终的话题。坦率的讲,我第一学期之后还是没有发现我真正的研究方向。NLP已经成为我AI方向中的头号Candidate。但是System那边还是希望能多explore一下再做最终决定。至少目前我是这样想的,但是不到课表确定的最后一刻,任何问题都还是说不定。确定了研究方向暑期研究具体做什么也就确定了很大一部分了。剩下的就是确定导师了。实习算是另外一个方向,主要是为了刷题多积累点动力。另外一学期的政治学习也积累了不少动力。

  • 有学校可上

18年底又又又要申请学校了,这次希望继续有神的保守。

这一切的一切都需要主的保守!

Advertisements

In relationships: a first taste

It’s October 30th today. I only have one more day left to compose a post for October. Blogging can be very hard during school time because there are endless tasks you need to get done in a timely fashion with certain expected results. Even though I have given up watching videoes, playing video games, writing technical blogs (almost) for this semester, I still want to write something here to keep the blogging trend going: I have written at least one post per month for the past two years. So, here it is.

There are many things happened in October and surprisingly, those things are all about the relationship: I got baptism to become a Christian, which indicates a new relationship with the God; I start seeing a woman, which is a relationship in a normal standard. One thing I am always curious about when I don’t involve those relationships is: how life can be different when you are in a relationship. Most of my knowledge on this matter is from the media and the people I observe. For the relationship with the God, I barely know anything. I haven’t actively thought about this since I graduated from the college and I won’t even think about being a Christian before coming to Austin. For the relationship with a woman, that I have been thinking about quite actively especially when I was a high school student. I always want to know the taste of being with someone. However, quite surprisingly, if you ask me now how life changed after being with God and being with a woman, I would say: the former one is quite significant but the latter one doesn’t change much.

Being with the God

Being with the God is a huge decision to me. I went to a church back in Madison for two years but I could barely feel anything internally. I always treat going church on Sunday morning as a way to sing some songs and take a break from study. However, after arriving in Austin and thanks to some incidents, the picture of God becomes clear to me. I start to feel the life journey I have been through is perfectly designed to me. Attending Madison for undergraduate makes me mentally strong to the setbacks and going back to China for work makes me grow up like an adult and start to learn all the soft skills I previously ignored: communication, love, and family. All those things prepare me to head back to the States and pursue the further study. In addition, I always know that I have sin but I don’t know what way can help me to get rid of that and start a new life. Even worse, I constantly get seduced by Satan to do the things that hurt my friends and my family. I know I’m wrong but the pleasure coming from the crime is just too much and that gives me the pulse to commit again next time. Thankfully, I have the chance to know the God and I get my way out of the vicious cycle.  After becoming a Christian, I learn to view things in God’s view and try to pass the love to others. I learn to forgive the conflict and do things in the honor of God. Thanks to God, he prepares a woman for me.

Being with a woman

Surprisingly, being in a relationship doesn’t change my life that much. I simply have one more person to care about and I need to allocate certain time for that person. This doesn’t differ from spending time with my parents previously. She is a Christian as well and we adhere to the same core values. All the rest of difference seems trivial to reconcile. However, we have been dating for like a month and we are still in the calibration period: we start to know more about each other and be careful with the relationship traps that people usually fall into. However, with the help of the God, I think I’ll be fine.

Leaving IBM

To be honest, this is probably the most difficult post I have ever written. This is majorly because there is a ton of stuff I want to say but I’m unsure whether I should keep them public or should keep it to myself. Another factor that makes this post hard to write is because the span of drafting. I have been drafting this post since April in 2016, right after when I decide to start the whole process of quit-IBM-and-get-a-PhD project.  I used to use this post as a log to record things and feelings when somethings happens around me at IBM. Frankly, if I take a look at the stuff I record (mostly are rantings) retrospectively, lots of stuff still hold but the anger just passes away with the time. So, that year-long drafting really makes me hesitate even more because the mood when those stuff are written are gone. However, two years can be a significant amount of time and quitting IBM can be called “an end of era” and I should give a closure to my happy-and-bitter experience with IBM anyway. So, here it goes.

 

Thank you, IBM!

I’m really thankful for the opportunities working with IBM. This experience really makes me grow both technically and mentally.  Technical-wise, I have the opportunity to get hands on experience with DB2 development. DB2 as a database engine is extremely complex. It has over 10 million lines of code and it is way beyond the scope of any school project. Working on those projects are quite challenging because there is no way you can get clear understanding of every part of the project. I still remember when I attend the new hire education on DB2, there is one guy says: “I have been working on the DB2 optimizer for over 10 years but I cannot claim with certainty that I know every bit of the component I own.” This fact really shocks me and based upon my experience so far, his claim still holds but with one subtle assumption, which I’ll talk about later. There are lots of tools are developed internally and reading through both the code and tool chains are a great fortune for any self-motivated developers. I pick a lots of skills alongside: C, C++, Makefile, Emacs, Perl, Shell, AIX and many more. I’m really appreciated with this opportunity and I feel my knowledge with database and operating system grow a lot since my graduation from college.

Mentally, there are also lots of gains. Being a fresh grad is no easy. Lots of people get burned out because they are just like people who try to learn swim and are put inside water: either swim or drown. I’m lucky that my first job is with IBM because the atmosphere is just so relax: people expect you to learn on your own but they are also friendly enough (majority of them) to give you a hand when you need help. I still remember my first ticket with a customer is on a severity one issue, which should be updated your progress with the problem daily. There is a lot of pressure on me because I really have no clue with the product at the very beginning. I’m thankful for those who help me at that time and many difficult moments afterwards. That makes me realize how important is to be nice and stay active with the people around you.  Because no matter how good you are with technology and the product, there are always stuff you don’t know. Staying active with people around you may help you go through the difficult moment like this by giving you a thread that you can start at least pull. In addition, participating with toastmasters club really improve my communication and leadership skills and more importantly, I make tons of friends inside the club. Without working at IBM, I probably won’t even know the existence of the toastmasters club. If you happen to follow my posts, you’ll see lots of going on around me when I work at IBM. Every experience you go through offer you a great opportunity to learn and improve yourself. Some people may look at them as setbacks but for me, I look at them as opportunities.

toastmasters1

( the picture on the left is all the comments people give to me about my speech and on the right is the awards I have earned inside the club in these two years)

With the help of all those experience, I have developed a good habit of writing blogs (both technical and non-technical), reading books, and keep working out six days per week. All those things cannot be possible if I work at a place where extra hour work commonly happened. I’m very thankful for IBM for this because staying healthy both physically and mentally are super critical for one’s career. Even though those stuff don’t directly come from IBM, but IBM does provide the environment to nurture this things to happen.

 

IBM has its own problem. The problem is centered around people. There are many words I want to say but I think I’ll keep them secretly but I want to show my point with a picture:

ibm_survey

I don’t know why IBM’s term “resource action” on firing employees and the sentence “IBM recognize that our employee are our most valuable resources.” bother me so much. I probably just hate the word “resource” as a way to directly describe people and how this word get spammed so much around IBM. I know everyone working for a big corporation is just like a cog in a machine. However, what I feel based upon lots of things happened around me is that IBM as its attitudes represented by its first-line managers (because those people I commonly work with) makes this fact very explicitly. It hurts, to be honest. No matter how hard you work and no matter how many prizes you have earned for yourself and your first-line manager, you are nothing more than a cog in a machine, which is not worth for high price to have you around because there are many cogs behind you that are ready to replace you. They are much cheaper, much younger, and more or less can work like you because your duty in the machine is just so precisely specified, which doesn’t really depend on how much experience you have had under your belt. To me, that’s devastating.

This leads to the problem that talented people are reluctant to stay with company. My mentor and the people are so good with DB2 have bid farewell to the team. That’s really sad to me because they are the truly asset to the company and the product. The consequence of this is that crucial knowledge is gone with people. Some quirks existing in the product are only known by some people and once they leave the company, the knowledge is gone with them. That makes mastering of the product even harder. That’s the subtle assumption that the person makes during the new hire education and that’s also part of the problem when working with legacy code. The whole legacy code issue is worth another post but one thing I now strongly believe is that any technical problem has its own root cause in company culture and management style. To me, I’m not a guru now but I cannot see the way to become a guru with my current position, which scares me the most

That’s it for this section and I’ll leave the rest to my journal.

Takeaway from DTCC 2017

由于同事出差,我有幸参加了在北京国际会议中心举办的第八届中国数据库技术大会(Database Technology Conference China 2017)。这是我第一次参加业界交流大会,内心还是格外兴奋的。这次大会确实有很多的收获,我想用这篇博客记录下来。本来我想用英文记录的,毕竟对于计算机领域,英文是我的“母语”,但是介于分享主要以中文为主,所以我就还是以中文来记录了。

会议目标

虽然机会来的很突然,但是我还是设立了一些目标以最大可能的利用好这次机会(以下是这篇博文的英文初稿,由于实在是懒着重新翻译成中文,各位就凑合着看吧):

Get some sense from the peers

Focus on your own product is quite important. However, it’s even more important to see how your peers doing. I’m not an architect yet but I feel it’s helpful to begin thinking like an architect and see what the problems that your peers are facing and how they try to solve them. In addition, by knowing how’s the going with your peers, you may get a measure of yourself: is the work you are doing on the same level as your peers? Are you in a good shape in the job market? What’s the gap you need to fulfill skill-wise?

Deepen the understanding of the field

Even almost two years working on the database field, I still think myself as a newbie. This is mainly because database is arguably the most complex software that people can ever make and there are tons of stuff I don’t know. So, I want to see in a high level that what’s the trend of the field and what kind of reflection that people derive from their day-to-day engineering practice. I think this may help me to catch-up with the masters.

AI or System?

As I disclosed in my last post, I decide to head back to school and get a master degree. To be honest, my ultimate goal is to acquire a PhD in Computer Science and currently I’m actively preparing for it. The most important question is that which field I want to study?  I have two options and I have some interests in both fields: AI and System. Why these two options and not others is worth a whole new post and I don’t want to discuss here. So, my task for now is to gather as much information as possible about these two fields and see which one looks more attractive to me. This event is extremely helpful because it has sharing on System as well as on AI.

Day 1

第一天分为上下半场。上午是开场及四个分享。下午则是五个同时进行的专场,每个专场有六个同一主题的分享。这就造成了我无法参加每一个分享。第一天我的策略就是面面俱到:系统的我也参加,AI相关的我也参加。以下就是针对我参加的每一场的一些心得感悟和评论:

年度主题解读 (曹鹏 – 京东金融副总裁)

本次会议的主题叫做“数据驱动,价值发现”。这个分享是从京东金融自身的角度对本次会议的主题进行了结构。从中我记住了两点:

  1. Finance领域受到了机器学习的冲击,最近几年有越来越多的FinTech公司出现。机器学习在这种公司的主要应用从这个分享来看是对客户群体更加精确的定位和分析。相应的,对于量化交易策略的作用,这个分享没有涉及。我最近一直比较关心机器学习在金融领域的应用,但是从这个分享上,我没有找到我想要找到的答案。因为,在我看来,对客户群体的精确定位是一种机器学习的通用应用,并不具备金融行业的独特性。
  2. 数据公司在我看来是一个不错的创业想法。分享中提到数据对于京东金融的重要性。他们不仅要求数据的广度,也要求数据的厚度。一个重要问题是数据是具有很强的时效性和冷热变化的。一年前顾客的消费记录对于现在来说并不具备非常强的指导意义。因此,京东金融每天都要收集大量的数据(~6TB)来保证整个分析的准确性。同时,演讲者透露出即便在这种情况下,他们觉得数据还是远远无法满足他们的需求的。这个就能解释为什么IBM最近收购了The Weather Company和医疗影像公司Merge Healthcare:无非就是看上了这两家公司的数据。这让我想做数据贩卖商会不会是一个不错的创业点子呢?

数据库发展概览 (吴承杨 – 甲骨文)

这场分享整体来说亮点不多。不过还是有一些重要信息的:

  1.  在去IOE喊了那么多年的今天,Oracle的市场占有率依然有56%之多
  2. 数据库的未来是云:这里演讲者用一个case讲述hybrid cloud的重要性。企业现在面临的问题是如何将公有云的数据和本地服务器上的数据有效的对接在一起以及如何将公有云私有化等。整场演讲更像是Oracle解决方案介绍会,技术方面很少涉及,但是指出了未来数据库发展的方向:上云。
  3. 演讲者台风不错,是一个不错的演讲者。

数据技术的下一站 – 数据应用 (王桐 – 永洪科技)

这个分享反应出永洪科技的主营业务和技术实力可能不是那么雄厚。整个分享我感受到永洪科技做的是数据库的应用开发,而不是数据库系统的本身。从这个分享中我了解到永洪把传统数据库以及大数据系统做了个集成平台,并在上面开发了针对不同行业应用的服务。这个感觉和IBM自家的Bluemix非常像,少的只是Watson系列。我个人看来做软件系统集成要比做系统本身难度要低很多。整个分享关注在永洪科技所提供的各种数据应用的服务。我查了一下,公司属于初创成立于2012年,我觉得走到今天这个地步也是不容易的。

整个分享亮点还是有的。一个是人物岗位关系图的展示,流程之间的pending关系以一种网状图的形式展现出来,每个节点是一个岗位。通过这种展示,我们能清晰看出哪个岗位人物最关键,他的缺席或者能力高低会对整个公司业务带来何种影响。另外一个亮点就是资源配置图。展现的是诸如会议室的使用情况,使用率等指标。但凡在IBM呆过的,对会议室这点肯定会深有体会:无数会议室被人预定却无发得到充分利用。我想这种资源展示应该是对我们这种会议室资源紧张的地方来讲会有很大帮助的吧?

达梦如何冲击核心业务系统 – 国产数据库的产品发展之路 (韩朱忠 – 达梦数据)

我觉得这个分享可能是今天最励志的分享了。整个分享讲的就是一个国产小厂商是如何奋斗和外资数据库斗争,一点点争取市场份额,成长到今天这个样子的。这里边讲到的一个关于他们对这个用C写的数据库的SQL优化能力进行提升的例子。 他们曾经遇到过一条SQL, 长达3.9K行,换句话说就是粘到word文档里能粘350多页。里边包含着17个inner join, 557个子查询, 831个or筛选, 1000+个查询字段,2731个case when。他们通过不断优化将这个SQL语句从几百分钟降到不到1秒。另外一个故事是讲国产数据库生存的艰辛。因为大企业及银行电信等核心产业的数据库都是采用外资的, 国产根本进不去。国产只能在中小企业市场去竞争。但是,这家数据库通过自身的不断努力,终于拿下国家电网的单子以及西藏和东方航空的单子。这在我看来是非常了不起的成就。这就让我对IBM产生了反思。我不觉得我们DB2能在不经过针对性的优化的情况下就能处理这么复杂的SQL语句。这个例子也让我觉得要么我们是在用我们的名声和过去的积累在赢得客户,要么就是DB2售前的同事在做POC的时候super tryhard。我明显感受到我们和这些国产数据库在努力程度上的差距。也许有一天我和他们的地位会呼唤?我相信这是IBM高层不愿意看到的事情。我们确实该努力了。

SSD的IO Determination特性在数据库业务优化中的应用与拓展 (阳学仕 – 宝存科技)

这个是从storage上出发来讲如何用软件模拟硬件来提升读写速度。换句话说,这个分享带给我的思考就是数据库怎样才能利用IO determination提升读写速度。这里讲的IO determination我粗浅理解看来就是让硬盘上的应用能更加和谐共处,并通过提升应用优先级,IO资源上下限,以及时间上对读写顺序进行优化等方式来使应用获得所需要的资源。另外SSD对于网络发展的匹配也有涉及:通过硬件的提升,我们现在基本可以做到本地写入和通过网络写入远程只有10几微秒的差距。这些在我看来是属于OS的领域。硬件对DB的加成这个方向让我感到耳目一新。

面向未来的数据库体系架构的思考 (张瑞 – 阿里巴巴)

这个主要介绍的是阿里巴巴里的AliSQL的架构以及针对阿里业务特点的数据库架构的反思。这里有两点我想提及:

  1. 国内厂商和IBM在对待数据库上有本质上的区别。国内厂商如阿里巴巴,腾讯,以及百度都是以自身业务痛点作为出发点对自家的数据库进行开发和改造。所以相应的,这些家的数据库改造,提升都是带有极强的针对性的。他们的数据库架构可能并不具备非常强的通用性。相反,IBM是把数据库作为产品来销售的,因此在数据库本身设计上考虑到的更多是面面俱到,大而全的尽可能满足所有用户类型的需求。这就导致在某些场景下,IBM的DB2做不到像AliSQL, OceanDB, TDB那样强劲。因此,在超大型公司做数据库,最终方向可能都是“私人订制”。
  2. 机器学习与系统结合的越来越紧密。这里演讲者提到他们想在未来把自动运维转换到智能运维上面来。SQL不再是DBA来手动看,而是通过ML的某种方式来进行优化。这些阿里的人还没有想好但是他们觉得这是未来的方向。

下午场综述

下午听的有”百度NewSQL数据库系统”, “Tencent MySQL内核优化解析”, “滴滴大数据应用”,“自然语言技术在文智趋势分析产品上的应用”。百度上最大收获是说现在分布式事物数据库非常的热,如果研究透,就没有在国内趟不过去的问题。另外一点收获就是不要过分崇拜Google系统。虽然细节我没有听的特别懂,但是从演讲者言语间我感受到,黑猫白猫抓到耗子就是好猫。有的时候不能太学究。而且系统之间即使是理念一模一样,但是由于implementation不同,也会导致巨大的性能差异。

腾讯的讲的非常Technical, 加上演讲者是技术出身,整个session非常的煎熬,感觉就是内核优化是个大坑,需要很扎实的DB知识。最后两场我选得是和机器学习相关的。不得不说没有达到我心中的理想。滴滴介绍的是他们一些数学模型应用的场景。我感觉演讲者应该是加入滴滴时间不长,并没有从一些模型上讲出个所以然来,反倒是应用场景上更让我感受到经济学家也是有用武之地的:比如说如何运用高峰涨价来调控司机和打车人之间的供求关系,以及如何收取取消订单等行为给平台所带来的损失。也许是民怨太重,整个滴滴分享感觉像是个新闻发布会。最后的自然语言技术应用是非常无聊的。演讲者是产品经理出身,主要介绍了下腾讯是如何针把NLP技术应用在新闻上的。非常泛泛,没有提及一些NLP上的技术难点,非常失望。

Day 2

第二天我觉得整体上不如第一天的精彩。主要原因我在想是方向性和行业发展战略性的内容比例在降低而具体技术内容所占比例在上升。不得不说的是通过这两天大会的观察,国内数据库领域MySQL系和Oracle系还是占主流,这主要是因为互联网行业的蓬勃发展。下面我就简单聊聊这一天的观察和体悟:

  • Informix现在是和物联网IOT紧密的捆绑在了一起

在IBM我的邻居就是Informix Technical Support组。他们组的老大之前也分享过Informix在物联网领域的应用。这在我看来是为Informix这个昔日的巨人在找新的发力点以获得新生。这点也在今天题为“万物互联时代的数据库支撑平台–SinoDB”上获得了印证。SinoDB可以理解为Informix的fork因为这个公司从IBM这里获得了Informix的源代码的授权。不得不说的是IBM在这里变成了吐槽的对象,这些以Informix元老员工成立的公司认为IBM并没有善待Informix这个继子。他们认为是时候把自己的“孩子”重新领回来让他茁壮成长了。这也让我不得不思考当初IBM收购Informix到底是为了什么?问了问和我一同参会的同事,Informix的代码是否已经和DB2的有机的融合在一起现在还是个未知数。这也让我明白为什么在Oracle收购MySQL之后会出现这么多MySQL的fork:毕竟不是亲儿子。

  • 问题的多重性和domain knowledge的重要性

下午场我就是盯着机器学习专场在听。其中我觉得来自连家的“机器学习技术在房屋估价中的应用”的分享最为有意思。分享的内容其实从标题就可以猜出个八九不离十。这个分享一个重要的信息就是机器学习并不是以算法为核心的而是以建立在以domain knowledge为支撑的加工过的data的基础上的。对于链家的问题就是他们的数据量是十万级的,远不及一些图像处理或者文本处理的亿级别的数据。另外他们的数据是类别变量和连续变量混合,连续变量有数量级差异;以及不可避免的脏数据。这些都很大程度上决定了要基于domain knowledge的feature engineering和针对数据特点的算法确定。现在想想也就不难理解为什么从在本科上统计课到现在看的Prof. Andrew Ng’s ML课程,大家拿到数据的第一步都是plotting:就是为了能更好的结合自己的domain knowledge来观察数据特点及预处理。另外说一句就是,在我看来从昨天的滴滴大数据应用到今天这场链家的机器学习应用,他们本质上处理的问题都是属于经济学范畴。与经济学中计量经济所不同的是,机器学习的方法更加暴力:分析数据就是分析数据,而不是先要把问题归类到经济,然后按照经济的科班套路先建模再通过数据验证模型的套路来解决问题。我这里不想说也不够资格说哪个解决问题的方式方法更好。我想说的是一个问题放在不同角度来解决套路真的是完全不一样。站在不同位置上看待同一个问题也许能会擦出更加明亮的火花?

Day 3

最后一天就是全天的专场了。前两天听下来基本上对System, ML方向有了个粗略的sense。到了第三天我就把重点放在了其他一些领域比如说区块链。这里我觉得讲的比较好的就是“区块链与大数据技术结合的商业应用”这场。可以看出的是区块链作为一个新兴技术,由于账本本身是公开的,可以把 这个想象成一个巨大的只支持insert和select的数据库,那么对于这个数据库里的数据挖掘和针对这个数据库所能做的一些优化就成为了现在区块链届关注的重点。据介绍现在这个账本已经有3,400G这么大。我另外了解到,分布式账本这种技术应用场景还是非常广泛的。比如说红十字会接受捐赠就可以利用区块链技术使得所有捐款信息完全透明公开。说句题外话,现在任何一个项目都需要不同类型的人才。系统,AI都有自己施展拳脚的空间。

小结

参加conference确实是一个非常愉快的体验。像我这种技术渣渣可以了解到各个领域的前进方向,找到自己努力的方向和未来的定位。和我一快来的同事就跟我说参加这个会议让自己更加坚定了当初自己选择的方向。另外,如果有丰富的工程经验也可以通过这次会议吸取同行的一些经验教训,取长补短。另外,丰富的networking机会也是这种会议的价值所在。

走出会议的那一刻,我觉得天空好蓝。

Decision

突然发现时间已经到了4月的最后一天。这个月我还没有在wordpress上写过任何博客。所以赶紧开始赶制这四月第一篇博客。

4月份发生的比较重大的事情就是录取结果陆续放出了。是的,我准备再度去美国读书,攻读计算机专业。读书这件事情其实筹备了很久,从去年的5,6月份考取GRE开始算的话,连准备考试,申请,到拿到申请结果,前前后后也快有一年的时间。今天这篇博客并不是想要去回答:为什么想要再出去读书,申请期间发生了什么事情等问题。这些我打算在我8月份的博客里去回答。今天,我只是想谈谈选录取offer这个话题。

研究生选offer和本科选offer还是有些不一样的。我还依稀记得本科选校的时候,就是在wisconsin和illinois之间选。那个时候主要是看综排并辅以专业排名。2010年wisconsin还是可以排到US News 35位的。另外看了看wisconsin在自然科学,社会科学排名方面都是基本在北美前10左右。最后学费上wisconsin也是低于illinois不少。所以最后就选择去了wisconsin。现在来看选择wisconsin我是一点没有后悔的。因为在那里锻炼了我坚毅的品格。课业的压力和暗无天日的长冬对于任何一个人从心理到生理上都是非常大的挑战。后来,忘记在哪里看到了一种叫badger holds的说法,说wisconsin出来的人不管走到哪里都能hold住全场。我想此言还是有些道理的。

到了研究生选校就是另外一番策略了。一般来讲是专排高于综排。换句话讲就是在研究生阶段是专业排名要比综合排名更加重要的。但是,在计算机领域,有四大神校:MIT, Stanford, UC-Berkeley, 和CMU。这四所学校是基本可以做到综排和专排兼顾的。所以如果被这四所学校录取的话,基本上可以做到无脑选择去了。这里说的是基本上,说明也有例外。这里我会在后边说。下面谈谈我对择校的反思。

先说下结果。这次我录取的项目有: CMU-SV MS-SE, Brown MS-CS, NYU MS-CS, GaTech MS-CS, UT-Austin MS-CS, UCSD MS-CS, CornellTech MMeng-CS, Columbia MS-CS. 最后我选择了UT-Austin MS-CS。

Know your goals:  employment or research?

这里说的是上Master的目的:是直接毕业找工作还是想要为未来PhD做准备?这条在本质上决定了选择offer的大方向。很少有项目能做到两者兼顾的。首先说说直接毕业找工作。如果是为了直接毕业找工作的话,那么学校placement statistics, 地理位置就要在决定过程中占有相对大的比例。与之相应的research实力,课程设置,导师等就不是考虑的重中之重了。如果以这个标准来看,CMU-SV MS-SE,Brown MS-CS, GaTech MS-CS, UCSD MS-CS, Columbia MS-CS, NYU MS-CS, CornellTech MMeng-CS就是些非常不错的选择了。再来说说研究方向,这里我们要看的就是教授,研究方向了。这里我并不是要说鱼和熊掌不可兼得,我想说的是每个项目都有不同的侧重点。

Big Department or Small Department?

系的大小也是影响决定的一个重要因素。Brown是第一个给我offer的,同时也是让我心动了很长时间。原因就是以Brown为代表的这种小而精的系,每个教授可以给每个学生最大的attention, 系里的氛围像大家庭一样。换句话讲,人均资源相对于那些大系来说会多一些。但是任何事物都不是完美的。系小的缺点就在于课程设置不会那么丰富并且研究领域会出现侧重:不会每个领域都会有教授的。我再来说说系大的特点。系大基本上就是系小取反。你面对的可能是更加激烈的竞争,资源就这些,每个人要去try their best to fight for the resources. 这里没有人会去babysitting,所以学生会被要求更加独立。但是,这不就是现实社会么?

Do a campus visit if you can!

其实专业排名,系的大小,你的兴趣所在都只是生活的一部分。最重要的是你要选择一个自己感觉到舒服的地方。毕竟在接下来的一到两年里,你要在这里学习生活。这个时候Campus visit就显得非常重要。去实地感受一下这里是不是真的适合你。去一个不适合自己的地方是一件非常痛苦的事情。我之前去过NYC,知道在NYC学习是一件多么不容易的事情,所以我知道如果可能的话,我还是比较适合college town。另外,在wisconsin学习的经历告诉我,天气同样是不可忽视的因素。这些都是排名等数据无法明确告诉你的。再多说一句,但凡在外边读过书的人都会知道图书馆的重要性。Wisconsin在这方面做的是非常非常好的。为什么呢?因为整个学校有43个大大小小的图书馆。我上学的时候最新欢光顾的就是Memorial, Law, Music,Astronomy, Econ这几所图书馆。每个系的building都会有图书馆的存在。如果我想的话,我可以根据心情挑不同图书馆来学习。但是,比如说GaTech, 整个campus只有一座图书馆,这对于一个喜欢泡图书馆的人来说,是非常难过的。这些因素都会很大程度影响一个人两年时间的开心与否的。

Carefully research the program!

其实在申请的时候去非常详细研究一个program是非常困难的。为什么呢?因为你的时间有限,而且研究的非常详细的话(比如哪个老师不好好备课,哪个老师上课很难这种),如果最终没有录取的话,那么你的努力就会白费。所以,很多人都是从一些指标和项目的粗略描述上来决定是否申请。但是,在得到录取结果后,就不能如此草率了。当时在做决定的时候,我最终在GaTech和UT-Austin做选择。我的做法是把每个学校老师和我兴趣沾边的都去翻了一遍,并且把两所学校的课程,每门课的主页都去翻了一下。我发现GaTech因为online master的原因,相当部分的课是看视频上课,老师负责答疑的。比如说,Machine Learning for Trading 这门课。上过MOOC的人都应该知道,网络版的课难度是比不上实体课的。因为受众群体不一样。这样如果你是想锻炼自己研究能力,去训练读paper的能力的话,像GaTech可能就不太适合。

打算这篇博客其实想了很久,因为在4月15日前我真的是非常纠结。但是,所幸的是,我还是仔细的去比较了每个项目,去发现项目之间的nuance, 然后做出了非常艰难的取舍。本来在写之前感觉自己会滔滔不绝写出很多。但是等真正落下笔去写,会发现其实选校的依据并没有自己想象的那么多。总结一句话,就是知道自己想要什么是整个选校过程中最重要的依据。但是,话说回来,这条哪件事不适用呢?

 

 

First time ever working as a host

I’m not sure how system works in other parts of the world, but in China, we usually throw a company-wide “party” near the end of the year. By “party” I don’t mean that people got hammered and play silly. The “party” is sponsored by the company as a thank-you event for all the employees. During the “party”, we usually do multiple rounds of lucky draws for the prizes and we also produce some shows – dancing, solo, rap, and so on. That is what we called “年会” in Chinese. Even for international companies like IBM, there is no exception to this convention.

Probably due to the really early spring festival (in January), we put off our “party” until today (Feb. 18th). However, I have to say that the preparation of this event starts long time ago. The audition for the host is on Jan. 14th and I’m guessing the preparation for this event really starts near the end of 2016. The reason I want to participate this event this year is that I want to make full out of the IBM experience. Usually, I’m not a huge fan of participating a big crowded entertaining event as an audience. I want to be in it and try to learn or have unique fun from my participation if possible. In addition, I have joined Toastmasters club for more than a year now and I want to see if I can really make some progress on the public speaking. One day when I actually receive the email calling for host audition, I make no doubt and click the “signup” button.

Boy, I have to say that show business can be quite energy consuming. Unlike working as a programmer dealing with physical or virtual devices, the central task in show business is around people. You need to try really hard to get people like you and enjoy the whatever stuff (i.e. voice, words, sentences, gestures) you deliver. The first big checkpoint for me is to pass the audition. When I actually get agenda for the audition, I realize the competition is somewhat fiercer than I thought. There are around 15 people competing for the hosts – two boys and two girls. Someone even tells me that the returning hosts from the previous year are also in this game. The task for audition is to read part of the script from previous year while staring at the camera. This makes me super nervous because camera is really like a black hole: you never get the feedback from the stuff you send to it. I have to push all my energy out and make myself super hype for this job even though that’s really not who I am in the daily life. I raise my voice super loud and weave my over-dramatic gestures in between. I walk around the stage like some rap star and try to make myself the owner of the stage. At some point, I feel blackout. I don’t care what lines I’m reading and I just push my boundary to make the whole atmosphere super hot. On my way to home, my brain couldn’t function properly and I fall deep asleep in the cab. Luckily, after almost two weeks, I get the callback from the casting director.

The next huge part of the task is working on the lines and repeatedly rehearsal with the other three hosts. Just like those documentary or footage showing what actors do in set on TV, we need to sit around and go through the script line by line to make sure we are working as a cohesive group to make the actual event go as smoothly as possible. Also, another big reason for this grinding is to get to know your partner. What he is comfortable with and what he is not. Probably unlike actors, we have almost full control on what we can say on the stage. Usually, we sit together and come up with a draft and then we send them to the review and then we repeat the same cycle for another draft. By the time we on the stage, the draft number is 21. The hardest part for me is that you need to separate the role from the actual yourself. In other words, I have to repeatedly tell myself that what you play on the stage is really not who you are in your daily life. People will not judge you by any means. This can be super hard and I can sense that actors may need to repeatedly tell themselves about this point specifically when they are really into the part they are playing. In my situation, since my partner and I are really the rookie to the hosting, we are in charge of the pre-show warmup and the transitions between different programs. Director definitely do not want to leave the lucky draw part for us because in that part, you need to deal with many big bosses who will be the guest to actually draw the number on the stage. You cannot say their titles wrong, you cannot say their names wrong and there are no script for bosses, so you have to act smart to handle any unexpected incidents. In order to make the atmosphere warm before the show, the casting crew’s idea is to play games. One of the game is that the audience needs to make the facial expression based upon the host description and I’m the one who makes the demo, which is a trademark facial expression of a famous Chinese comedian “小岳岳”:

5f66841255

I have to say it is a big challenge for me because I don’t use weibo, which is the major repository for those GIFs and I’m not really into this meme style setting. But I somehow still make it and with some self-loathing mindset.

Rehearsal is really time consuming and frustrating. We do rehearsal yesterday from 1pm to 10pm and this morning from 9am to 12pm. The major part of time has nothing to do with hosting but with the program itself. The reason we stuck in there partly due to we need to work on the actual transition and keep refining lines. Some problems about the lines can hardly be observed by reading off the stage. For example, originally, my partner should make a gesture by putting her arms in parallel to make me look like I’m doing the facial expression in TV. However, we realize that this is impossible to do on the stage because she is holding a microphone on one of her hands and the distance between she and me is beyond her reach. Another example is from the other group. Since they are majorly in charge of the lucky draw part, there are lots of gadgets need to be put onto the stage. For instance, the box contains all the numbers that the guest should pick from. We don’t really consider there is a time chunk we need to say something to avoid the awkward silence while the staff try to put the box on to the stage. There are many examples like this when we do rehearsal and to my surprise, new problems happen no matter how many times we have rehearsed on the stage.

1:30pm today is when we need to actually get the job done. Without doubt, problems happen. My partner has really slim body and the address she choose is a little bigger. It takes almost 20 minutes for her to somewhat fix the address on her body and we are supposed to be on the stage to do pre-show warmup at 1:30pm. In the end, the warmup is cut into only one game and the order of lines are messed up. I don’t blame my partner because things always happen for a live show. This makes me realize there is really a lot of stuff need to practice and to learn as a professional host and experience for this profession is really really important. One thing in this scenario is that you need to be smart and keep your rhythms  on the stage even the procedure doesn’t meet with your expectation.

Overall this is really a unique experience for me and I actually learn something from it. The following is some notes I take when we have a training with a professor from Communication University of China. The session is conducted in Chinese and I don’t know the corresponding term in English. So bear with me:

  • 视线一般瞄准主机位。若紧张可以斜向上25度。
  • 视线一般要照顾到每位观众。以主机位为轴,左右45度形成的扇形为实现覆盖区域。
  • 视线一般要照顾全场,即左手区域,中间区域,右手区域,每个区域视线停留5秒左右
  • 上台四点一线:头,肩,臀,脚后跟。站直。不可以有小动作,乱晃
  • 男士那麦克风的手自然下垂。上台时也保持这样姿势即可。
  • 话筒离下嘴唇两只手距离,保证收音效果。

Lastly, let me post some photos from the event as a good memory for this incredible journey.

This slideshow requires JavaScript.

 

 

A closing speech for tomorrow’s Toastmasters’ gathering

Ladies and gentlemen, we just had a wonderful speech sharing from our guest speakers. Let’s give them a round of applause. I want to give a quick speech as a closure to this wonderful night.

As everyone can see, Anne performs extremely well tonight both as a toastmaster member but also as a host. She joined our club for almost a year now and there are no words can describe how much she has grown to what she is right now. Watching her tonight’s great performance, I actually start to look at myself to reflect the life journey I have so far.

I want to tell you guys that I’m never an extrovert guy. Back in the college, I’m more comfortable with paper, pencil, and keyboard than talking with people, especially with the girls. That’s part of the reason why I become triple major in computer science, economics, and mathematics. I make myself super busy so that I don’t have free time to be social. College career is a little bit rough for me. I never think I will fail a course someday. The course I fail called Modern Algebra. There are only three questions during the final exam and I can answer part of first question. When I spend most of the time making doodles on the exam paper, I know something terrible is  going to happen. But, when this guts feeling actually becomes the truth, I break down. I lock myself inside the apartment and keep questioning myself how this can possibly happen. Then, one day, I watch a Japanese drama called Dragon Zakura, in Chinese, 龙樱. This show talks about a bunch of least talented students fight their way to the University of Tokyo, the most prestigious university in Japan. This show echoes something in my heart. “I’m not the guy who allow himself to be defeated without putting out a good fight.” I always believe myself in the deep deep down of my heart but sometimes this fact just got covered by the mist. “Let’s do this again!” I tell myself. The following semester, I take the same course with the same instructor once again. You know what, I nail it. I got straight A in that course and that’s the moment I confirm with myself one more time: “I never allow myself to be defeated without putting out a good fight. In fact, when I do put out a fight, nothing can defeat me.” Julius Caesar has a famous quote “I came, I saw, I conquered”. Only the difficulties can make us stronger.

When I come back to China and join IBM as a software engineer, I quickly realize that technical leadership is one side of the coin. How to communicate with people is the other side. Once I realize this, Caesar’s quote once again haunting in my mind, “I came, I saw, I conquered”. I see the problem I need to solve, and the rest is that I directly face it and I know eventually I will conquer it. Lucky enough, I know Toastmaster right about time. I join the club immediately and six months later, I become the president of the club. Onto the stage is a very tough step, but once you do that, and actually keep doing it, I guarantee you that you’re gonna love it. That’s why people love to do workout or running because they know that for every extra pound they lift or every extra mile they run, they are going to be stronger than they could ever possibly imagined.

So join us right now and begin the journey to perfect yourself. You’re gonna suffer for sure but that’s the place where the healing process start. Once you power through, there’s going be to a whole new world awaiting you to see.

Thank you guys. Have a wonderful night!