Amazon Web Services just released a new AI code completion tool called AWS CodeWhisperer. It is a competitor to Microsoft's GitHub Copilot tool, but is free to for everybody to use. Let's take a first look at CodeWhisperer and review its performance. 

#programming #tech #TheCodeReport

💬 Chat with Me on Discord

https://discord.gg/fireship

🔗 Resources

CodeWhisperer https://aws.amazon.com/codewhisperer
AWS Generative AI Announcement https://aws.amazon.com/blogs/machine-learning/announcing-new-tools-for-building-with-generative-ai-on-aws/
AWS for the Haters https://youtu.be/ZzI9JE0i6Lc
GitHub CopilotX https://youtu.be/q1HZj40ZQrM

🔥 Get More Content - Upgrade to PRO

Upgrade at https://fireship.io/pro
Use code YT25 for 25% off PRO access 

🎨 My Editor Settings

- Atom One Dark 
- vscode-icons
- Fira Code Font

🔖 Topics Covered

- AWS CodeWhisperer vs GitHubCopilot
- Free AI code completion tools
- What is the AWS bedrock tool?
- How to modify Stable Diffusion with your own data
- Running ML models in the cloud
- What is AWS Titan?
- How to build custom generative AI apps?
2024-02-04T13:25:19.344Z
nova-2
2-general-nova
2024-01-09.29447
30089e05-99d1-4376-b32e-c263170674af
1a6b472b-65ab-4888-86a0-71d9edc469bc
bce9c0e4066976d5411c1b0c7876d4443621cb599f13c303f8a3d509d9734d05
67875a7f-c9c4-48a0-aa55-5bdb8a91c34a
deprecated
It is April 14, 2023, and you're watching the code report.
We're living through a development tooling space race right now, and GitHub Copilot is just the tip of the rocket.
There's a long shaft of other tools competing in the space that's growing girthier every day, all of which are seeded by a massive foundational models.
Yesterday, Amazon Web Services released a new code generation tool called Code Whisperer.
And unlike its biggest competitor Copilot, which is powered by Microsoft and OpenAI, it's 100% free for everybody.
That's a huge deal.
Last week, I made a big mistake by poking the AWS bear with this video, but this week it comes back and totally redeems itself.
It has some very cool unique features, and today we'll compare it head to head with Copilot, but that's not everything AWS just announced.
They Also just launched web service number 69,421 called Bedrock.
It allows developers to access large foundational models on AWS infrastructure, making it possible for the average dude who doesn't own a pile of GPUs to build highly customized AI applications.
It has image models like stability AI Stable Diffusion, and LLMs like AI 21 Labs Jurassic models.
In addition, AWS also announced 2 of its own foundational models for both text and image assessing called Titan.
What's crazy for image models is that all you need to do to build something custom is upload some labeled images to S3.
Like, say you wanna make fashion models obsolete Jesse, We need to produce more Balenciaga.
You might be able to get the job done with as few as 20 images.
And if that weren't crazy enough, AWS also made its New ML training EC 2 instances generally available, which are based on Inferentia chips.
These are custom built chips that can train machine learning models at about 50% of the normal cost on EC 2, and that means you could train your own LLM from scratch for only $5,000,000 instead of $10,000,000.
Platforms like Cohere and Hugging Face are already using this behind the scenes, but let's get back to CodeWhisperer, which you can use for free right now.
1st, install Saw the Versus Code or JetBrains extension, then enable it by registering.
Open up a code file, then hit option c to generate some code.
You can also In the extension options here and enable auto suggestions, which will generate code as you go.
I'm currently running it in a Next JS project, and it seems to A pretty good job of understanding the context of the project.
Like here, it exported a default function component, which is exactly what I was hoping for.
And as you can see here, it generated perfect Use effect code for me.
Also, you can hit the arrow keys to get additional suggestions as needed.
Compared to Copilot, I found that it usually doesn't suggest as much code.
Like, typically, it just goes line by line, whereas As in Copilot, it might suggest 50 lines of code at one time.
This is both a good and a bad thing because sometimes Copilot just recommends a bunch of annoying nonsense, but it can also be very Useful when you have a lot of boilerplate like an HTML form.
But, most importantly, I wanna make sure this thing can write regular expressions.
It works great for simple patterns like phone numbers, but becomes It's harder to prompt as the pattern gets more complex.
Still extremely useful though.
I also want to see if this thing could write unit tests, so I created a testing file and, no joke, it wrote an Angular a component for some reason.
I think it's trying to tell me something.
It kinda failed there, but it also does some really cool things that GitHub Copilot doesn't.
Like, for 1, it will give you a reference to the code in the training data when producing its own code.
It's awesome to have that transparency and also makes it less likely that you accidentally steal some code and and then use it in ways you're not allowed to.
The legal picture behind these tools is still very murky.
There's a class action lawsuit against GitHub Copilot right now We're being trained on billions of lines of public code without providing credit.
In addition, stock image supplier Getty Images is suing stability API for its art generation tools.
It's only a matter of time before the lawyers Ruin AI for everybody, so enjoy it while it lasts.
Another cool feature of CodeWhisperer though is security scans.
You get 50 of these per month, and they can check web applications for OWASP issues, like Keep your sites vulnerable to cross site scripting, or if you're building your own shitcoin, they can also analyze smart contracts.
And, of course, it can point out how you're not using AWS properly.
The bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close
to being on par Bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par with Copilot, and most importantly, it's free.
But this is only the beginning.
If you were born before 2021, you might Remember the days when AI couldn't even write code?
You had to use these primitive tools like Google and Stack Overflow.
This AI rocket is moving fast, but it hasn't climaxed yet.
Maybe it'll go limp and disappoint us, or maybe it's about to plant the seed for the next generation of artificial general programmers.
Only time will tell.
This has been the Code Report.
Thanks for watching, and I will see you in the next one.

Speaker 0: It is April 14, 2023, and you're watching the code report. We're living through a development tooling space race right now, and GitHub Copilot is just the tip of the rocket. There's a long shaft of other tools competing in the space that's growing girthier every day, all of which are seeded by a massive foundational models. Yesterday, Amazon Web Services released a new code generation tool called Code Whisperer. And unlike its biggest competitor Copilot, which is powered by Microsoft and OpenAI, it's 100% free for everybody.

That's a huge deal. Last week, I made a big mistake by poking the AWS bear with this video, but this week it comes back and totally redeems itself. It has some very cool unique features, and today we'll compare it head to head with Copilot, but that's not everything AWS just announced. They Also just launched web service number 69,421 called Bedrock. It allows developers to access large foundational models on AWS infrastructure, making it possible for the average dude who doesn't own a pile of GPUs to build highly customized AI applications.

It has image models like stability AI Stable Diffusion, and LLMs like AI 21 Labs Jurassic models. In addition, AWS also announced 2 of its own foundational models for both text and image assessing called Titan. What's crazy for image models is that all you need to do to build something custom is upload some labeled images to S3. Like, say you wanna make fashion models obsolete Jesse, We need to produce more Balenciaga. You might be able to get the job done with as few as 20 images.

And if that weren't crazy enough, AWS also made its New ML training EC 2 instances generally available, which are based on Inferentia chips. These are custom built chips that can train machine learning models at about 50% of the normal cost on EC 2, and that means you could train your own LLM from scratch for only $5,000,000 instead of $10,000,000. Platforms like Cohere and Hugging Face are already using this behind the scenes, but let's get back to CodeWhisperer, which you can use for free right now. 1st, install Saw the Versus Code or JetBrains extension, then enable it by registering. Open up a code file, then hit option c to generate some code.

You can also In the extension options here and enable auto suggestions, which will generate code as you go. I'm currently running it in a Next JS project, and it seems to A pretty good job of understanding the context of the project. Like here, it exported a default function component, which is exactly what I was hoping for. And as you can see here, it generated perfect Use effect code for me. Also, you can hit the arrow keys to get additional suggestions as needed.

Compared to Copilot, I found that it usually doesn't suggest as much code. Like, typically, it just goes line by line, whereas As in Copilot, it might suggest 50 lines of code at one time. This is both a good and a bad thing because sometimes Copilot just recommends a bunch of annoying nonsense, but it can also be very Useful when you have a lot of boilerplate like an HTML form. But, most importantly, I wanna make sure this thing can write regular expressions. It works great for simple patterns like phone numbers, but becomes It's harder to prompt as the pattern gets more complex.

Still extremely useful though. I also want to see if this thing could write unit tests, so I created a testing file and, no joke, it wrote an Angular a component for some reason. I think it's trying to tell me something. It kinda failed there, but it also does some really cool things that GitHub Copilot doesn't. Like, for 1, it will give you a reference to the code in the training data when producing its own code.

It's awesome to have that transparency and also makes it less likely that you accidentally steal some code and and then use it in ways you're not allowed to. The legal picture behind these tools is still very murky. There's a class action lawsuit against GitHub Copilot right now We're being trained on billions of lines of public code without providing credit. In addition, stock image supplier Getty Images is suing stability API for its art generation tools. It's only a matter of time before the lawyers Ruin AI for everybody, so enjoy it while it lasts.

Another cool feature of CodeWhisperer though is security scans. You get 50 of these per month, and they can check web applications for OWASP issues, like Keep your sites vulnerable to cross site scripting, or if you're building your own shitcoin, they can also analyze smart contracts. And, of course, it can point out how you're not using AWS properly.

Speaker 1: The bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close

Speaker 0: to being on par Bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par with Copilot, and most importantly, it's free. But this is only the beginning. If you were born before 2021, you might Remember the days when AI couldn't even write code? You had to use these primitive tools like Google and Stack Overflow. This AI rocket is moving fast, but it hasn't climaxed yet.

Maybe it'll go limp and disappoint us, or maybe it's about to plant the seed for the next generation of artificial general programmers. Only time will tell. This has been the Code Report. Thanks for watching, and I will see you in the next one.
It is April 14, 2023, and you're watching the code report. We're living through a development tooling space race right now, and GitHub Copilot is just the tip of the rocket. There's a long shaft of other tools competing in the space that's growing girthier every day, all of which are seeded by a massive foundational models. Yesterday, Amazon Web Services released a new code generation tool called Code Whisperer. And unlike its biggest competitor Copilot, which is powered by Microsoft and OpenAI, it's 100% free for everybody. That's a huge deal. Last week, I made a big mistake by poking the AWS bear with this video, but this week it comes back and totally redeems itself. It has some very cool unique features, and today we'll compare it head to head with Copilot, but that's not everything AWS just announced.
youtube
software
space exploration
software development
amazon
robotics
They Also just launched web service number 69,421 called Bedrock.
It allows developers to access large foundational models on AWS infrastructure, making it possible for the average dude who doesn't own a pile of GPUs to build highly customized AI applications. It has image models like stability AI Stable Diffusion, and LLMs like AI 21 Labs Jurassic models. In addition, AWS also announced 2 of its own foundational models for both text and image assessing called Titan. What's crazy for image models is that all you need to do to build something custom is upload some labeled images to S3. Like, say you wanna make fashion models obsolete Jesse, We need to produce more Balenciaga. You might be able to get the job done with as few as 20 images. And if that weren't crazy enough, AWS also made its New ML training EC 2 instances generally available, which are based on Inferentia chips. These are custom built chips that can train machine learning models at about 50% of the normal cost on EC 2, and that means you could train your own LLM from scratch for only $5,000,000 instead of $10,000,000.
architecture
modeling
machine learning
graphic design
software development
computer science
Platforms like Cohere and Hugging Face are already using this behind the scenes, but let's get back to CodeWhisperer, which you can use for free right now.
1st, install Saw the Versus Code or JetBrains extension, then enable it by registering. Open up a code file, then hit option c to generate some code. You can also In the extension options here and enable auto suggestions, which will generate code as you go. I'm currently running it in a Next JS project, and it seems to A pretty good job of understanding the context of the project.
programming
Like here, it exported a default function component, which is exactly what I was hoping for. And as you can see here, it generated perfect Use effect code for me. Also, you can hit the arrow keys to get additional suggestions as needed. Compared to Copilot, I found that it usually doesn't suggest as much code.
programming
Like, typically, it just goes line by line, whereas As in Copilot, it might suggest 50 lines of code at one time. This is both a good and a bad thing because sometimes Copilot just recommends a bunch of annoying nonsense, but it can also be very Useful when you have a lot of boilerplate like an HTML form. But, most importantly, I wanna make sure this thing can write regular expressions. It works great for simple patterns like phone numbers, but becomes It's harder to prompt as the pattern gets more complex. Still extremely useful though. I also want to see if this thing could write unit tests, so I created a testing file and, no joke, it wrote an Angular a component for some reason.
I think it's trying to tell me something. It kinda failed there, but it also does some really cool things that GitHub Copilot doesn't. Like, for 1, it will give you a reference to the code in the training data when producing its own code. It's awesome to have that transparency and also makes it less likely that you accidentally steal some code and and then use it in ways you're not allowed to.
software
The legal picture behind these tools is still very murky. There's a class action lawsuit against GitHub Copilot right now We're being trained on billions of lines of public code without providing credit. In addition, stock image supplier Getty Images is suing stability API for its art generation tools. It's only a matter of time before the lawyers Ruin AI for everybody, so enjoy it while it lasts.
copyright
patents
copyright licenses
software
Another cool feature of CodeWhisperer though is security scans. You get 50 of these per month, and they can check web applications for OWASP issues, like Keep your sites vulnerable to cross site scripting, or if you're building your own shitcoin, they can also analyze smart contracts. And, of course, it can point out how you're not using AWS properly. The bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par Bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par with Copilot, and most importantly, it's free.
But this is only the beginning. If you were born before 2021, you might Remember the days when AI couldn't even write code? You had to use these primitive tools like Google and Stack Overflow. This AI rocket is moving fast, but it hasn't climaxed yet. Maybe it'll go limp and disappoint us, or maybe it's about to plant the seed for the next generation of artificial general programmers. Only time will tell. This has been the Code Report. Thanks for watching, and I will see you in the next one.
artificial intelligence
rockets
robotics
It is April 14, 2023, and you're watching the code report. We're living through a development tooling space race right now, and GitHub Copilot is just the tip of the rocket. There's a long shaft of other tools competing in the space that's growing girthier every day, all of which are seeded by a massive foundational models. Yesterday, Amazon Web Services released a new code generation tool called Code Whisperer. And unlike its biggest competitor Copilot, which is powered by Microsoft and OpenAI, it's 100% free for everybody. That's a huge deal. Last week, I made a big mistake by poking the AWS bear with this video, but this week it comes back and totally redeems itself. It has some very cool unique features, and today we'll compare it head to head with Copilot, but that's not everything AWS just announced. They Also just launched web service number 69,421 called Bedrock. It allows developers to access large foundational models on AWS infrastructure, making it possible for the average dude who doesn't own a pile of GPUs to build highly customized AI applications. It has image models like stability AI Stable Diffusion, and LLMs like AI 21 Labs Jurassic models. In addition, AWS also announced 2 of its own foundational models for both text and image assessing called Titan. What's crazy for image models is that all you need to do to build something custom is upload some labeled images to S3. Like, say you wanna make fashion models obsolete Jesse, We need to produce more Balenciaga. You might be able to get the job done with as few as 20 images. And if that weren't crazy enough, AWS also made its New ML training EC 2 instances generally available, which are based on Inferentia chips. These are custom built chips that can train machine learning models at about 50% of the normal cost on EC 2, and that means you could train your own LLM from scratch for only $5,000,000 instead of $10,000,000. Platforms like Cohere and Hugging Face are already using this behind the scenes, but let's get back to CodeWhisperer, which you can use for free right now. 1st, install Saw the Versus Code or JetBrains extension, then enable it by registering. Open up a code file, then hit option c to generate some code. You can also In the extension options here and enable auto suggestions, which will generate code as you go. I'm currently running it in a Next JS project, and it seems to A pretty good job of understanding the context of the project. Like here, it exported a default function component, which is exactly what I was hoping for. And as you can see here, it generated perfect Use effect code for me. Also, you can hit the arrow keys to get additional suggestions as needed. Compared to Copilot, I found that it usually doesn't suggest as much code. Like, typically, it just goes line by line, whereas As in Copilot, it might suggest 50 lines of code at one time. This is both a good and a bad thing because sometimes Copilot just recommends a bunch of annoying nonsense, but it can also be very Useful when you have a lot of boilerplate like an HTML form. But, most importantly, I wanna make sure this thing can write regular expressions. It works great for simple patterns like phone numbers, but becomes It's harder to prompt as the pattern gets more complex. Still extremely useful though. I also want to see if this thing could write unit tests, so I created a testing file and, no joke, it wrote an Angular a component for some reason. I think it's trying to tell me something. It kinda failed there, but it also does some really cool things that GitHub Copilot doesn't. Like, for 1, it will give you a reference to the code in the training data when producing its own code. It's awesome to have that transparency and also makes it less likely that you accidentally steal some code and and then use it in ways you're not allowed to. The legal picture behind these tools is still very murky. There's a class action lawsuit against GitHub Copilot right now We're being trained on billions of lines of public code without providing credit. In addition, stock image supplier Getty Images is suing stability API for its art generation tools. It's only a matter of time before the lawyers Ruin AI for everybody, so enjoy it while it lasts. Another cool feature of CodeWhisperer though is security scans. You get 50 of these per month, and they can check web applications for OWASP issues, like Keep your sites vulnerable to cross site scripting, or if you're building your own shitcoin, they can also analyze smart contracts. And, of course, it can point out how you're not using AWS properly. The bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par Bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par with Copilot, and most importantly, it's free. But this is only the beginning. If you were born before 2021, you might Remember the days when AI couldn't even write code? You had to use these primitive tools like Google and Stack Overflow. This AI rocket is moving fast, but it hasn't climaxed yet. Maybe it'll go limp and disappoint us, or maybe it's about to plant the seed for the next generation of artificial general programmers. Only time will tell. This has been the Code Report. Thanks for watching, and I will see you in the next one.
It
it
is
is
April
april
14,
14
2023,
2023
and
and
you're
you're
watching
watching
the
the
code
code
report.
report
We're
we're
living
living
through
through
a
a
development
development
tooling
tooling
space
space
race
race
right
right
now,
now
and
and
GitHub
github
Copilot
copilot
is
is
just
just
the
the
tip
tip
of
of
the
the
rocket.
rocket
There's
there's
a
a
long
long
shaft
shaft
of
of
other
other
tools
tools
competing
competing
in
in
the
the
space
space
that's
that's
growing
growing
girthier
girthier
every
every
day,
day
all
all
of
of
which
which
are
are
seeded
seeded
by
by
a
a
massive
massive
foundational
foundational
models.
models
Yesterday,
yesterday
Amazon
amazon
Web
web
Services
services
released
released
a
a
new
new
code
code
generation
generation
tool
tool
called
called
Code
code
Whisperer.
whisperer
And
and
unlike
unlike
its
its
biggest
biggest
competitor
competitor
Copilot,
copilot
which
which
is
is
powered
powered
by
by
Microsoft
microsoft
and
and
OpenAI,
openai
it's
it's
100%
100%
free
free
for
for
everybody.
everybody
That's
that's
a
a
huge
huge
deal.
deal
Last
last
week,
week
I
i
made
made
a
a
big
big
mistake
mistake
by
by
poking
poking
the
the
AWS
aws
bear
bear
with
with
this
this
video,
video
but
but
this
this
week
week
it
it
comes
comes
back
back
and
and
totally
totally
redeems
redeems
itself.
itself
It
it
has
has
some
some
very
very
cool
cool
unique
unique
features,
features
and
and
today
today
we'll
we'll
compare
compare
it
it
head
head
to
to
head
head
with
with
Copilot,
copilot
but
but
that's
that's
not
not
everything
everything
AWS
aws
just
just
announced.
announced
They
they
Also
also
just
just
launched
launched
web
web
service
service
number
number
69,421
69,421
called
called
Bedrock.
bedrock
It
it
allows
allows
developers
developers
to
to
access
access
large
large
foundational
foundational
models
models
on
on
AWS
aws
infrastructure,
infrastructure
making
making
it
it
possible
possible
for
for
the
the
average
average
dude
dude
who
who
doesn't
doesn't
own
own
a
a
pile
pile
of
of
GPUs
gpus
to
to
build
build
highly
highly
customized
customized
AI
ai
applications.
applications
It
it
has
has
image
image
models
models
like
like
stability
stability
AI
ai
Stable
stable
Diffusion,
diffusion
and
and
LLMs
llms
like
like
AI
ai
21
21
Labs
labs
Jurassic
jurassic
models.
models
In
in
addition,
addition
AWS
aws
also
also
announced
announced
2
2
of
of
its
its
own
own
foundational
foundational
models
models
for
for
both
both
text
text
and
and
image
image
assessing
assessing
called
called
Titan.
titan
What's
what's
crazy
crazy
for
for
image
image
models
models
is
is
that
that
all
all
you
you
need
need
to
to
do
do
to
to
build
build
something
something
custom
custom
is
is
upload
upload
some
some
labeled
labeled
images
images
to
to
S3.
s3
Like,
like
say
say
you
you
wanna
wanna
make
make
fashion
fashion
models
models
obsolete
obsolete
Jesse,
jesse
We
we
need
need
to
to
produce
produce
more
more
Balenciaga.
balenciaga
You
you
might
might
be
be
able
able
to
to
get
get
the
the
job
job
done
done
with
with
as
as
few
few
as
as
20
20
images.
images
And
and
if
if
that
that
weren't
weren't
crazy
crazy
enough,
enough
AWS
aws
also
also
made
made
its
its
New
new
ML
ml
training
training
EC
ec
2
2
instances
instances
generally
generally
available,
available
which
which
are
are
based
based
on
on
Inferentia
inferentia
chips.
chips
These
these
are
are
custom
custom
built
built
chips
chips
that
that
can
can
train
train
machine
machine
learning
learning
models
models
at
at
about
about
50%
50%
of
of
the
the
normal
normal
cost
cost
on
on
EC
ec
2,
2
and
and
that
that
means
means
you
you
could
could
train
train
your
your
own
own
LLM
llm
from
from
scratch
scratch
for
for
only
only
$5,000,000
$5,000,000
instead
instead
of
of
$10,000,000.
$10,000,000
Platforms
platforms
like
like
Cohere
cohere
and
and
Hugging
hugging
Face
face
are
are
already
already
using
using
this
this
behind
behind
the
the
scenes,
scenes
but
but
let's
let's
get
get
back
back
to
to
CodeWhisperer,
codewhisperer
which
which
you
you
can
can
use
use
for
for
free
free
right
right
now.
now
1st,
1st
install
install
Saw
saw
the
the
Versus
versus
Code
code
or
or
JetBrains
jetbrains
extension,
extension
then
then
enable
enable
it
it
by
by
registering.
registering
Open
open
up
up
a
a
code
code
file,
file
then
then
hit
hit
option
option
c
c
to
to
generate
generate
some
some
code.
code
You
you
can
can
also
also
In
in
the
the
extension
extension
options
options
here
here
and
and
enable
enable
auto
auto
suggestions,
suggestions
which
which
will
will
generate
generate
code
code
as
as
you
you
go.
go
I'm
i'm
currently
currently
running
running
it
it
in
in
a
a
Next
next
JS
js
project,
project
and
and
it
it
seems
seems
to
to
A
a
pretty
pretty
good
good
job
job
of
of
understanding
understanding
the
the
context
context
of
of
the
the
project.
project
Like
like
here,
here
it
it
exported
exported
a
a
default
default
function
function
component,
component
which
which
is
is
exactly
exactly
what
what
I
i
was
was
hoping
hoping
for.
for
And
and
as
as
you
you
can
can
see
see
here,
here
it
it
generated
generated
perfect
perfect
Use
use
effect
effect
code
code
for
for
me.
me
Also,
also
you
you
can
can
hit
hit
the
the
arrow
arrow
keys
keys
to
to
get
get
additional
additional
suggestions
suggestions
as
as
needed.
needed
Compared
compared
to
to
Copilot,
copilot
I
i
found
found
that
that
it
it
usually
usually
doesn't
doesn't
suggest
suggest
as
as
much
much
code.
code
Like,
like
typically,
typically
it
it
just
just
goes
goes
line
line
by
by
line,
line
whereas
whereas
As
as
in
in
Copilot,
copilot
it
it
might
might
suggest
suggest
50
50
lines
lines
of
of
code
code
at
at
one
one
time.
time
This
this
is
is
both
both
a
a
good
good
and
and
a
a
bad
bad
thing
thing
because
because
sometimes
sometimes
Copilot
copilot
just
just
recommends
recommends
a
a
bunch
bunch
of
of
annoying
annoying
nonsense,
nonsense
but
but
it
it
can
can
also
also
be
be
very
very
Useful
useful
when
when
you
you
have
have
a
a
lot
lot
of
of
boilerplate
boilerplate
like
like
an
an
HTML
html
form.
form
But,
but
most
most
importantly,
importantly
I
i
wanna
wanna
make
make
sure
sure
this
this
thing
thing
can
can
write
write
regular
regular
expressions.
expressions
It
it
works
works
great
great
for
for
simple
simple
patterns
patterns
like
like
phone
phone
numbers,
numbers
but
but
becomes
becomes
It's
it's
harder
harder
to
to
prompt
prompt
as
as
the
the
pattern
pattern
gets
gets
more
more
complex.
complex
Still
still
extremely
extremely
useful
useful
though.
though
I
i
also
also
want
want
to
to
see
see
if
if
this
this
thing
thing
could
could
write
write
unit
unit
tests,
tests
so
so
I
i
created
created
a
a
testing
testing
file
file
and,
and
no
no
joke,
joke
it
it
wrote
wrote
an
an
Angular
angular
a
a
component
component
for
for
some
some
reason.
reason
I
i
think
think
it's
it's
trying
trying
to
to
tell
tell
me
me
something.
something
It
it
kinda
kinda
failed
failed
there,
there
but
but
it
it
also
also
does
does
some
some
really
really
cool
cool
things
things
that
that
GitHub
github
Copilot
copilot
doesn't.
doesn't
Like,
like
for
for
1,
1
it
it
will
will
give
give
you
you
a
a
reference
reference
to
to
the
the
code
code
in
in
the
the
training
training
data
data
when
when
producing
producing
its
its
own
own
code.
code
It's
it's
awesome
awesome
to
to
have
have
that
that
transparency
transparency
and
and
also
also
makes
makes
it
it
less
less
likely
likely
that
that
you
you
accidentally
accidentally
steal
steal
some
some
code
code
and
and
and
and
then
then
use
use
it
it
in
in
ways
ways
you're
you're
not
not
allowed
allowed
to.
to
The
the
legal
legal
picture
picture
behind
behind
these
these
tools
tools
is
is
still
still
very
very
murky.
murky
There's
there's
a
a
class
class
action
action
lawsuit
lawsuit
against
against
GitHub
github
Copilot
copilot
right
right
now
now
We're
we're
being
being
trained
trained
on
on
billions
billions
of
of
lines
lines
of
of
public
public
code
code
without
without
providing
providing
credit.
credit
In
in
addition,
addition
stock
stock
image
image
supplier
supplier
Getty
getty
Images
images
is
is
suing
suing
stability
stability
API
api
for
for
its
its
art
art
generation
generation
tools.
tools
It's
it's
only
only
a
a
matter
matter
of
of
time
time
before
before
the
the
lawyers
lawyers
Ruin
ruin
AI
ai
for
for
everybody,
everybody
so
so
enjoy
enjoy
it
it
while
while
it
it
lasts.
lasts
Another
another
cool
cool
feature
feature
of
of
CodeWhisperer
codewhisperer
though
though
is
is
security
security
scans.
scans
You
you
get
get
50
50
of
of
these
these
per
per
month,
month
and
and
they
they
can
can
check
check
web
web
applications
applications
for
for
OWASP
owasp
issues,
issues
like
like
Keep
keep
your
your
sites
sites
vulnerable
vulnerable
to
to
cross
cross
site
site
scripting,
scripting
or
or
if
if
you're
you're
building
building
your
your
own
own
shitcoin,
shitcoin
they
they
can
can
also
also
analyze
analyze
smart
smart
contracts.
contracts
And,
and
of
of
course,
course
it
it
can
can
point
point
out
out
how
how
you're
you're
not
not
using
using
AWS
aws
properly.
properly
The
the
bottom
bottom
line
line
here
here
is
is
that
that
CodeWhisperer
codewhisperer
might
might
not
not
be
be
a
a
game
game
changer,
changer
but
but
it's
it's
pretty
pretty
close
close
to
to
being
being
on
on
par
par
Bottom
bottom
line
line
here
here
is
is
that
that
CodeWhisperer
codewhisperer
might
might
not
not
be
be
a
a
game
game
changer,
changer
but
but
it's
it's
pretty
pretty
close
close
to
to
being
being
on
on
par
par
with
with
Copilot,
copilot
and
and
most
most
importantly,
importantly
it's
it's
free.
free
But
but
this
this
is
is
only
only
the
the
beginning.
beginning
If
if
you
you
were
were
born
born
before
before
2021,
2021
you
you
might
might
Remember
remember
the
the
days
days
when
when
AI
ai
couldn't
couldn't
even
even
write
write
code?
code
You
you
had
had
to
to
use
use
these
these
primitive
primitive
tools
tools
like
like
Google
google
and
and
Stack
stack
Overflow.
overflow
This
this
AI
ai
rocket
rocket
is
is
moving
moving
fast,
fast
but
but
it
it
hasn't
hasn't
climaxed
climaxed
yet.
yet
Maybe
maybe
it'll
it'll
go
go
limp
limp
and
and
disappoint
disappoint
us,
us
or
or
maybe
maybe
it's
it's
about
about
to
to
plant
plant
the
the
seed
seed
for
for
the
the
next
next
generation
generation
of
of
artificial
artificial
general
general
programmers.
programmers
Only
only
time
time
will
will
tell.
tell
This
this
has
has
been
been
the
the
Code
code
Report.
report
Thanks
thanks
for
for
watching,
watching
and
and
I
i
will
will
see
see
you
you
in
in
the
the
next
next
one.
one
success
In this video, Speaker 0 discusses the release of a new code generation tool called Code Whisperer, which is 100% free and has some unique features like image models and a new web service called Bedrock. They also mention other foundational models for AWS infrastructure, including Titan and In the Development Center. Speaker 1 discusses a potential legal lawsuit against GitHub Copilot for its AI tools, and Speaker 0 mentions a free, though not game changer, CodeGenerationisperer.
AWS CodeWhisperer… The Copilot Killer?
It is April 14, 2023, and you're watching the code report. We're living through a development tooling space race right now, and GitHub Copilot is just the tip of the rocket. There's a long shaft of other tools competing in the space that's growing girthier every day, all of which are seeded by a massive foundational models. Yesterday, Amazon Web Services released a new code generation tool called Code Whisperer. And unlike its biggest competitor Copilot, which is powered by Microsoft and OpenAI, it's 100% free for everybody. That's a huge deal. Last week, I made a big mistake by poking the AWS bear with this video, but this week it comes back and totally redeems itself. It has some very cool unique features, and today we'll compare it head to head with Copilot, but that's not everything AWS just announced. They Also just launched web service number 69,421 called Bedrock. It allows developers to access large foundational models on AWS infrastructure, making it possible for the average dude who doesn't own a pile of GPUs to build highly customized AI applications. It has image models like stability AI Stable Diffusion, and LLMs like AI 21 Labs Jurassic models. In addition, AWS also announced 2 of its own foundational models for both text and image assessing called Titan. What's crazy for image models is that all you need to do to build something custom is upload some labeled images to S3. Like, say you wanna make fashion models obsolete Jesse, We need to produce more Balenciaga. You might be able to get the job done with as few as 20 images. And if that weren't crazy enough, AWS also made its New ML training EC 2 instances generally available, which are based on Inferentia chips. These are custom built chips that can train machine learning models at about 50% of the normal cost on EC 2, and that means you could train your own LLM from scratch for only $5,000,000 instead of $10,000,000. Platforms like Cohere and Hugging Face are already using this behind the scenes, but let's get back to CodeWhisperer, which you can use for free right now. 1st, install Saw the Versus Code or JetBrains extension, then enable it by registering. Open up a code file, then hit option c to generate some code. You can also In the extension options here and enable auto suggestions, which will generate code as you go. I'm currently running it in a Next JS project, and it seems to A pretty good job of understanding the context of the project. Like here, it exported a default function component, which is exactly what I was hoping for. And as you can see here, it generated perfect Use effect code for me. Also, you can hit the arrow keys to get additional suggestions as needed. Compared to Copilot, I found that it usually doesn't suggest as much code. Like, typically, it just goes line by line, whereas As in Copilot, it might suggest 50 lines of code at one time. This is both a good and a bad thing because sometimes Copilot just recommends a bunch of annoying nonsense, but it can also be very Useful when you have a lot of boilerplate like an HTML form. But, most importantly, I wanna make sure this thing can write regular expressions. It works great for simple patterns like phone numbers, but becomes It's harder to prompt as the pattern gets more complex. Still extremely useful though. I also want to see if this thing could write unit tests, so I created a testing file and, no joke, it wrote an Angular a component for some reason. I think it's trying to tell me something. It kinda failed there, but it also does some really cool things that GitHub Copilot doesn't. Like, for 1, it will give you a reference to the code in the training data when producing its own code. It's awesome to have that transparency and also makes it less likely that you accidentally steal some code and and then use it in ways you're not allowed to. The legal picture behind these tools is still very murky. There's a class action lawsuit against GitHub Copilot right now We're being trained on billions of lines of public code without providing credit. In addition, stock image supplier Getty Images is suing stability API for its art generation tools. It's only a matter of time before the lawyers Ruin AI for everybody, so enjoy it while it lasts. Another cool feature of CodeWhisperer though is security scans. You get 50 of these per month, and they can check web applications for OWASP issues, like Keep your sites vulnerable to cross site scripting, or if you're building your own shitcoin, they can also analyze smart contracts. And, of course, it can point out how you're not using AWS properly. The bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par Bottom line here is that CodeWhisperer might not be a game changer, but it's pretty close to being on par with Copilot, and most importantly, it's free. But this is only the beginning. If you were born before 2021, you might Remember the days when AI couldn't even write code? You had to use these primitive tools like Google and Stack Overflow. This AI rocket is moving fast, but it hasn't climaxed yet. Maybe it'll go limp and disappoint us, or maybe it's about to plant the seed for the next generation of artificial general programmers. Only time will tell. This has been the Code Report. Thanks for watching, and I will see you in the next one.
In this video, Speaker 0 discusses the release of a new code generation tool called Code Whisperer, which is 100% free and has some unique features like image models and a new web service called Bedrock. They also mention other foundational models for AWS infrastructure, including Titan and In the Development Center. Speaker 1 discusses a potential legal lawsuit against GitHub Copilot for its AI tools, and Speaker 0 mentions a free, though not game changer, CodeGenerationisperer.