What Developers Think About GitHub Copilot

Announced by Github on June 29, 2021, GitHub Copilot is an artificial intelligence tool developed by GitHub that assists developers by intelligently suggesting and autocompleting code. GitHub Copilot boasts of being powered by OpenAI’s Codex, an emerging code generator trained on billions of open source code from GitHub's coffers and public code on the internet. The AI is offered a VSCode extension to act as a peer programmer for developers while they are writing code.

Since its announcement, GitHub Copilot has attracted various reactions from its target community, developers, software engineers and architects. While some think it is a great development that will assist them in delivering their tasks faster, a faction is afraid AI is gradually taking over their roles.

From the criticisms to praises from developers and software stakeholders, this article shares the view of developers on GitHub Copilot.

An early user of the alpha version of the Copilot, a Hackernews user who goes by the username "fzaninotto", lauds how accurately it suggests code completions.

This is a view that many other developers and stakeholders share.

Philip Basile, a software consultant, also recounts his experience as one of the early users of the tool.

Cassidy Williams, the director of the developer experience at Netlify, shared her feedback on InfoWorld:

Adding comments to code is one of the most recommended best coding practices that many developers struggle to keep up with. GitHub Copilot's suggestion and auto-completion accuracy has particularly been linked with descriptive comments.

"Overall I just love how seamlessly GitHub Copilot can show you suggestions on VSCode. Beautifully done" is Hrithwik Bharadwaj's view on the good side of the Copilot.

Even though the GitHub Copilot offers so many interesting features for a first-gen product, developers and many stakeholders have recorded bad experiences. They have been able to point out a host of faults.

GitHub has faced a lot of legal heats as regards copyright infringement. The face leading the copyright criticism is the Free Software Foundation, which tagged Microsoft's offering "unacceptable and unjust." This move was triggered by talks from multiple developer activists who suggest that Microsoft is jacking code. This is in spite of the fact that the Copilot landing page declared that GitHub Copilot is "a code synthesizer, not a search engine: the vast majority of the code that it suggests is uniquely generated and has never been seen before. We found that about 0.1% of the time, the suggestion may contain some snippets that are verbatim from the training set."

Even though a fellow developer argued this with him, stating, "And what about code done by humans? It's also full of bugs and takes a lot of time to be done", the prior is still not convinced.

He insists that "Code done by a human has a human paying attention as they go along and thinking things through." While this might be a very good point to reflect on, GitHub Copilot also allows checking the suggested code before adding it to your project.

Another serious issue GitHub Copilot is facing is security. On August 20, 2021, Cornell University published a paper titled "An Empirical Cybersecurity Evaluation of GitHub Copilot's Code Contributions." The authors of the report, Hammond Pearce, Baleegh Ahmad, Benjamin Tan, Brendan Dolan-Gavitt, Ramesh Karri, claimed that they "explore[d] Copilot's performance on three distinct code generation axes - examining how it performs given diversity of weaknesses, diversity of prompts, and diversity of domains."

Of the 89 scenarios and 1,692 programs generated, the team revealed that an alarming 40% of the code is vulnerable. The paper advised that developers using the GitHub Copilot take steps to minimize the introduction of weak code into their projects.

While some of the allegations raised against the Copilot may be valid, others are fueled by fear and uncertainty of AI taking over the developer’s job.

Sam Altman also tweeted: "Prediction: AI will cause the price of work that can happen in front of a computer to decrease much faster than the price of work that happens in the physical world. This is the opposite of what most people (including me) expected, and will have strange effects."

Suggesting code snippets to developers as they write code invalidates the need for an assistant, and evolution might mean many things. However, chances that AI would replace the main developer are considered slim, in the nearest future, at least.

Even if this will be the case, the scope of programming is a dynamic and never-ending one making it almost impossible for any machine to single-handedly write code that can solve real-life issues, at least in the foreseeable future.

The GitHub Copilot is built as an advanced code suggestion tool to help developers write code faster and eliminate boring, repetitive tasks. It's still in its early stages, and there's still room for many improvements to be made to make it an acceptable and secure developer's pair programmer.